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ABSTRACT \ 
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Preface 



Tlie need for a document of this type becomes painfully obvious every fall when 
the latest test results are made public. Confusion, suspicion, and consternation often 
fill the air, if only for a few days. Many of the consequences of reporting local 
results spring from misunderstanding and poor communication. This handbook is 
designed to provide the test coordinator in each district with the special information 
and assistance he or she needs to help the public and the press draw accurate 
conclusions from the results of the California Assessment Program and to gain their 
support for the local educational program. 

A survey of district practices and problems in reporting and disseminating test 
results conducted last spring provided the direction and content for this document. 
Tlie County School Office Communication Specialists supported the idea for this 
document from its inception and helped to shape its initial focus. They also helped 
by keeping the report on target thioughout its production and by providing essential 
information and materials. 

Every effort has been made to keep the handbook at a practical level. This goal 
led to the inclusion of a variety of background summaries and illustrative materials 
which show what other districts are doing to meet the challenge of making test 
results meaningful and useful. School personnel are encouraged to use the materials 
in ways that will help them meet educational goals, therefore, they may reproduce 
any si of this handbook without seeking prior approval. The suggestions found in 
this Handbook are just that ideas gleaned from persons with years of experience. 

Several individuals deserve special recognition for the time and effort they 
devoted to this project. Julia Stanfill, Public Information Officer for the Office of 
the San Bernardino County Superintendent of Schools, was responsible for doing 
the initial research, conceptualizing the report, and preparing a first draft. Jerry 
Custis relied on first-hand experiences in reporting local results in writing the final 
draft of the document. Two other persons were very generous in providing 
information and guidance from the "firing line" perspective. Norman Ginsburg, 
Director of Research and Testing for the Ocean View Elementary School District, 
Huntington Beach; and Earl Owens, Research Consultant for the Office of the Los 
Angeles County Superintendent of Schools. We in the Department of Education are 
grateful to all of these individuals and their organizations for their unselfish efforts 
on this important project. 

DONALD R. McKINLEY ALEXANDER L LAW 

Chief Deputy Superintendent Chief, Office of Program 

of Public Instruction Evaluation and Research 
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Introduction: How We 



Approximately 1.4 million California schoolchil- 
dren sit down at their desks each year and take a 
moderately difficult 20- to 40'niinute test. The test 
is unusual in that^the pupils who take it do nof 
receive a grade. Instead, the broad-scale results will 
be used to judge their school's curriculum, method 
of instruction, and overall program effectiveness. 
Some citizens, in fact, will draw even broader 
conclusions from this testing conclusions on the 
success or failure of entire programs of instruction 
or of California's public schools themselves. 

That pupil testing has risen to such importance 
is not an isolated phenomenon. Throughout our 
society, cost-effectiveness and accountability havp 
become cardinal. Stockholders keenly await 
earnings-per-share reports. Defense planners seek 
efficient means of weapons deploy nient. Even 
quarterbacks live or die on pass-completion statis- 
tics. 

The Education Inveslnienl 

Public education is being held to the same 
standard. Americans spend upwards of 550 billion 
a year on elementary and secondary education. 
Like the skilled consumers most of them are, they 
are concerned with what they get lor their money. 
Whether Johnny can or cannot read remains a 
paramount concern of most parents. But they ^nd 
their no.iparent neighbors are asking other ques- 
tions as well: Are current instructional methods 
working? Are there better methods? What will 1 get 
for the additional money invested? Where can 
improvements best be made? To these questions, 
mass testing of pupils seeks to provide answers. 

Standardized testing as we know it did not 
spring forth full-blown. In many ways it resulted 
from the new, central role given education ni the 
early 1960s. Better schools were seen as the most 



Got Here and Why 



likely path to egalitarianism and improved social 
opportunity. Education was given greater atten- 
tion, greater funding, and inevitably much closer 
scrutiny. 

In 1961 California school districts for the first 
time were required by law to test pupil achieve- 
mjsnt. Because the choice of tests was lefi to each 
school district, however, comparisons in perfor- 
mance between school districts was difficult or 
impossible. In 1965 uniform reading tests were 
used statewide, and, for the first time valid state- 
wide conclusions as to performance in reading 
could be drawn. The trend continued. Leading 
educators were called together in 1969 1/ the 
Assembly Education Committee to discuss ways in 
which tht reporting system could .be improved. 
Their recommendations were made law in 1972 
under legislation sponsoicd by Assemblyman 
Leroy Greene, Chairman of the California Assem- 
bly Education Committee. That legislation-now a 
part of the Education Code-is the basis of the 
California Assessment Program.' 

Across ihe Nalion 

California was not alone in extending pupil 
testing. In 1964 a series of conferences convened 
by U.S. Commissioner of Education Francis 
Keppel resulted in the National Asjyessment of 
Educational Progress (NAEP) project. Now directed 
by the Education Commission of the States and 
supported by federal funding, NAEP conducts 
random sampling in numerous states to evaluate 
the status of education across the nation. From 
Congress came the 1965 Elementary and Second- 



See the resource material for Chapter U for the fuii (c.\t of 
lid 11 cat ion Code sections at ice ting the Cult forma Assessment iVo- 
gram . ^ 
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dry Lditcation Aci aiul other fcJcral fuiuling 
program:*, aiul C\ihrorma itbcll bpoiiburcJ such 
> programs as Early Chiklhood Education. These 
' programs added to the need for measurement to 
show how effectively program money was being 
Used. 

Other states have taken a path similar to 
Calilbrma's. Michigan, for example, provides a 
system of diagnostic testing to correct areas of 
weakness m pupil performance, hlorida, Missouri, 
New Jersey, New Mexico, Pennsylvania, Texas, and 
others have programs like the California Assess- 
ment Program. Somc"^ states have adopted the 
NAEP exercises for the state level. In all, more 
than 30 states now have some type of pupil 
assessment program. Most assessment programs are 
tied into state educational objectives for reading 
and mathematics. 

The Impact of testing 

Testing has come a long vva> in a few years. 
Teachers and test designers have learned farMnore 
accurate and sophisticated fcchniques in the past 
tWo decades. So, alsu, has the sophistication of 
parents and the public grown. Percentiles, medians, 
and other measurement terms have become widely 
familiar. Givcji mfuimatiun, niucli of the public 
IS able to make clear judgments about success 
and failure in the schools. Clearly, not only 
pupils concern themselves with test results: their 
teachers, principals, and superintendents also have 
a considerable stake in the result. 

Thus has grown the role of the testing director. 
To the previous responsibilities (of testing, evaluat- 
ing results, and reporting them back to teachers) 
have now been added .several more responsibilities 
of equal or greater significance: 

• Reporting results accurately and concisely to 
boards of education, press, parents, public, 
and students 

• Interpreting results to the specialists: teachers, 
principals, and other school district staff 
members 



♦ 

• Recommending improvements, where needed, 
in curricuhim and instnictional methods and , 
organization 

An Impossible Job? 

What appears to be a difficult assignment is also 
a most important one. The results of testing form a 
crucial role in the way people judge, support, and 
fund their schools. The testing director must 
summarize, clarify, explain, and make relevant that 
which is most important in the copious data 
needed in the California Assessment Propjam 
(CAP). 

To do so, however, is to do but half tiie job. 
Public interest in how the schools are doing^varies 
from community to community, from group to 
group within the community, and from person to 
person. Thus, different information is demanded 
by persons in different positions. Testing results 
must be comnuiiucated in somewhat different 
wa>;s" to parents, pupils, teachers, nonteacliiiig 
staft, administrators, taxpayers, and school board 
members. 

Evaluation, communication, and explanation 
demand a planned, organized approach. The 
resource material in this chapter contains an 
outline of what some school districts are doing. 
The remainder of this handbook provides assis- 
tance to testing directors in performing their jobs 
effectively. 

Who Is Tested in the California 



Assessment 


Pr()<:raiu? 


Grade 


Number of pupils 


One 


313.919 


Two 


291.952 


Tlircc 


289.990 


Six 


330.008 


Twelve 


245.700 


Total 


1.47 K569 



Figures are for 1975-7(). 
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Resource Material for Chapter 1 

How They Do II in Other Dislricls 



School testing directors in Calilbrniji^ were 
suneycd in the spring of 1^>76 on ways they use 
and report testing results. Excerpts froiii replies to 
'Uhc questionnaire submitted by directors in 550 
school districts are presented as follows: 



1, 



Which groups received the 1974-75 results of 
the California Assessment Program (CAP) for 
your district? 





Percent of ^ 




school districts" 


School board members 


98 


Principals 


90 


Curriculum specialists 


48 


Blenientary teachers 


78 


Secondary teachers 


28 


Department chairpersons ^ 


25 


Students i 


6 


Parent groups 


34 


School advisory councils 


39 


Other 


13 



When did you report 1974-75 state assessment 
results to your school board? 

Percent of 
school districts 



November 

December 

January 

February 

March 

April 

May October 
Never 



40 
37 
14 

3 

I 

I 

4 

0.5 



3. What data from the state assessment report did 
you report lo your school board? 

Percent of 
school diuricts 



District level: 

District mean score 
(percent correct) 



88 



'Ml ffplii's AiK' ImmhI on .1 uiunl ol how manv scliool disUicls 
chccUtI J speiilu Uoin. •! hrro lU) a<l|usti)icnl Jor clcrncntarv, UiyM 
sch*>o|. «ir iiniticti school thstncts. Some hydros .iri\ theruforo, 
inisk'adinL*. Allhoii^h 2.S pcuont ol tlu' disUicts replying uulicatud 
thai scfondarv liMchcrs h.ul <a*n the results, fhc reader must 
rfiiunnlH-r thai only percent ot the districts rn the state have hijih 
schools ami hniio li., r set ondary teachers lo report. 



Percentile rank 
Comparison score band 
Interpretation index 

;hool-li>y-sV:hool: 
Percent correct 
Percentile rank 
Comparison score band 
Interpretation index 
Subcontent area scores 



99 
75 
76 

52 
63 
57 
51 
38 



4. Which of the following information did you 
include in the report to your school board? 



Results of othtjfteks admin- 
istered' in your cMstrict 

Stiitc assessment. data for pre- 
vious years 

District-level 1974-75 state 
assessment data 

School-by-school 1974^75 
state assessment data 



Pcrccn f of 
School districts 



57 
53 



44 



5. What degree of difficulty did you encounter in 
explaining the various parts of your report to 
your school board? 

Percent of 
school districts 



None 
Little 
Some 
Great 

No response 



38 
25 
15 
4 
18 



6» How would you describe the manner in which 
the press reported 1974-75 state testing 
results? 



Accurately and objectively 

Accurately, but with distort- 
ing headlines 

inaccurately 

Other: don't know and so 
forth 



Percent of 
Sihool district t 

46 



24 
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7. \Vhi*.h of llic follow ing sltilc ci;>scbsmcnt results 
were published by the press? 



District level results 
District mean score 

\J (percent correct) 
iPercentile rank of district 
Interpretation index 

School-by-school results: 
Average percent correct 
Percentile rank 
Interpretation index 



}\'rccnt of 
school districn 



46 
o7 
30 



13 
25 
II 



8. What was the souice of information for the 
newspaper coverage of state assessment results? 

Fcrciiiit of 
school districts 



Report prepared for school 

board 
Interviews 
Press release 
Copy of school district 

profiles ^'^ 
Summary fact sheer 
Copy of school-by-school 

reports 
County 
State 

No response; don't know: 
and so forth 



44 
27 
23 

18 
U) 

8 
5 
4 

15 



9. What practices luvc you found to be ni^t 
successful in your distnct when coninumicatnig 
with the press about test results? 



Itstablish an on-going Relation- 

ship with the press 
Release the report prepared 

for the school board 
Conduct personal interview 

with reporter 
luicourage district-initiated 

contact with press 
Let press contact school 

district 

Prepare- sample press releases 
Hold press conference 
Other 



Percent of 
school iltstricts 



47 
38 



23 

15 
12 
7 
5 



10. Which of the following practices do you 
employ in communicating school test resists to 
principals? 



Distribute reports to schools 
Hold group meeting 
Review results with each 

principal 
No response; don't know; 

and so forth 



Percent of 
school districts 

59 
49 

43 

23 



1 1 . When are principals informed of test resujts? 

Percent of 
school districts 

Immediately on receipt 70 
Not until state release date in 

November 1 9 

Other I 

No response 10 

1.2. If you administer other standardized tests, are 
the results of these tests generally consistent 
with state assessment findings: 

a. In terms of the rank ordering of schools (i.e., 
do the schools generally emerge in the same 
order in overall achievement)? 

Percent of 
school districts 

Yes 63 
No '9 
No response; not appli- 
cable 28 

b. In terms of the pattern of strengths and 
weaknesses revealed at the school level (for 
example, strong in reading, weak in mathe- 
matics)? 

Percent of 
school districts 



Yes 
No 

No response, not appli- 
(;able 



06 
9 



3. Have state test data triggered further explo- 
ration into areas of weakness in your school 
programs? 



Yes 

N'o ' 

No response 



Percent of 
school districts 

()9 
30 



iO 



14. Have there been any program changes as a 
consequence of state test results? 

Percent of 
school districts 



Yes 
No 

No response 



55 
41 
4 



15. If you have disLOvered any successful tech- 
. niques for communicating test results to 
various groups, please describe the techniques. 
Sample responses were as follows: 

Personal ' prcseraation with lime to answer 
questions. 

Special presentation to reading specialists using 
skill areas to discuss progress in those curriculum 
areas. 



Graf presentation using transparency.^ 

Parents are given a standardized test themselves as 
a sample. ^ 

With parents: small group meetings to describe 
construction of tests, what purposes iliey serve, 
what scores mean, answer questions. 

Present nit'orm»jtion at their level of understdnding 
and in terms of their needs. * 

The school psychologist has a meeting with each 
faculty to explain and to discuss results. 

Graphs made up fron\ state reports to fit district 
profile are not useful. 

Keep it simple for all groups. 
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A Profile of the California Assessment Program 



The program of statewide testing shall i^rovidc the public, the Legislature^ and school districts 
evaluative information regarding the various levels of proficiency achieved by different groups of 
pupils of varying socioeconomic backgrounds, 
districts jnay allocate educational resources in 
opportunity for all pupils, . . . 



The California Assessment Program (CAP) is a 
mandated state effort to mea^are the progres: of 
pupils in the public schoo. -or this purpose 
annual tests aie given to ch. in grades one, 
two, three, six, and twelve at tidies specified by the 
State Department of education. 

From the time of testing, a few months are 
required for the independent storing contractor to 
score, compile, print, and distribute the results and 
for the Department to evaluate them. The results 
are reported each November in Sacramento by the 
Department and, in addition, are publicly reported 
by local school districts shortly thereafter. The law 
is specific in requiring the reporting of the results 
to the State Legislature, State Board of Education, 
and local boards of education, but Aiost :>tate anJ 
local educators also make sure that results are given 
in useful form to the media, parents, school 
administrators, teachers, and others. 



A Little History 

Statewide testing programs in California have 
always had their baas in the law.' They were first 
required by the Legislature in 1961. Acting under 
that law, the State Board of Education established 
testing in grades five, eiglit, and eleven and issued a 
list of approved tests from which school districts 
could select. 



I'or a summary and text of the present law, sec the resource 



materials for this chapter. 



so (hat the Legislature at.d individual school 
a manner to assure (he maximum educational 

Education Code Section 1 2821 

In \9( the state's Miller-Unruh Basic Reading 
Act required that reading achievement ^tests be 
administered in grades one, two, and three, with 
the btate t<^ provide uniform t,;.sts to all school 
districts. In connection with this legislation, the 
Stale Board of Education eliminated the tests it 
had required for students in grades five, eight, and 
eleven and, in theiii.place, required reading tests for 
students in ^ ^s six and ten in addition to pupils 
in gr:»des one Lirough three. 

The law affecting! ttjtewide testing was changed 
again in 1969. Vihereas reading tests had been 
required formerly in graJes six and ten, the new 
legislation now requireu testmg in reading and 
basic academic skills in grades six and twelve. At 
the same time the law mandatcJ for the first time 
the reporting of results district by district. 



The Presenl Program 

The current California > Assessment Program, 
brought into being by the signing into law of 
Assembly ' Bill 665 in 1972, represents a major 
overh Uii of sta**- testing. Both the structure and 
content of state iwi^ng have been changed. Testing 
in grades one, t.wo, three, six, and twelve has been 
retamed, but a grade one Lntr} Lei^l Tei>t ha^ been 
substituted for the previous reading achievement 
"^test. The legislation eliminates the testing of 
scholastic aptitude in all grades. It permits the state 
to design its own tests to refiect tne objectives of 
California schools rather than purchase tests from 

o 



f 



piiblibhcrj) and requires the ^tatc to pa> the cobts ot' 
the tebtyig aikl beoriiig. F"inall>, the legislation 
permits the use of matrix sampling (for all tests 
except the Entry Level Test) as a means of 
estimating group acliiev»^ment. (^latrix sampling is 
explained in detail further on in this chapter.) 



Design of the Tests 

Translating law uito practice took considerable 
effort. Much was accomplished by advisory com- 
mittees of experts: teachers, school district curricu- 
lum specialists, staff in offices of county superin- 
tendents of schools, State Department of Educa- 
tion task forces, .niembers of professional associa- 
tions, and college and university faculties.^ pie 
committee members first reviewed the basic sub- 
ject material taught at each level to be tested and 
from the material derived specific content themes 
for testing. Their work was formah/.ed in the 
^publication of major objectives for each grade level 
and content area to be tested. 

Front these objectives the specialists turned to 
actual test questions. For the most part questions 
were selected froui a pool of test questions already 
written and validated by eonimereial publishers. 



I or e\amplc, Hk content of the ^raJc twelve test waf Jjusen 
by three 4dvis<)ry coinniittces: reading (17 members); I:nglisli (34 
members); and mathematics (18 members). These consisted of 31 
persons Irom local school di<^triu(s, 23 from colleges i\nd universities, 
rant from offices of ci>unty .supcrintenJcnt.s of ,sJn)ols. and m\ . 
from the Department of lulneation. 



They were closely examined by linguists to elimi- 
nate imprecision, misleading terms, or bias. Field- 
tested and <igain \alidated, the tests were ready for 
use. 



Timeline for the CA^P 

The Entry Vevel Test for grade one went into 
use in. October, 1973, the first of the ni3w tests in 
the Cl\lifornij Assessment Program. Others fol- 
lowed in tltrs order: 



Grades two, three 
Grade twelve 
Grade six 



Spring, 1974 
January, 1975 
Spring, 1975 



Use of the Test Results 

Test results have achieved major importance in 
guiding action on instructional management and in 
keeping the public informed. The publication of 
test results has had the foltowing effects;-^ 

• At the state level: 

Enactment of legislative mandates requiring ' 
schools to concentrate on specific sujbject 
areas 

o /Approval of funds for subject areas and 
school levels needing increased assistance 



Sec Cliapter \ Un more detailed giitdanuc tui ihc Kjca! use uf 
testing results. 



What Subjects Arp Te^txnl? 

Outlined here are the subject areas tested at each gnlde level in. the California 
Assessment Program: 



Grade level 
One 



Name of test 
Entry Level Test . 



Subject areas 



Two u J three Reading Test 
Six 

Twelve 



When tested 



Reading readiness, visual and auditory Lato Sept. 



discrimination early Oct. 

M^eading progress ^ May 

Survey of Basic Skills Reading, written expression, spelling, " Late April 

mathematics early May 

Survey of Basic Skills Reading, written expression, spelling, 

mathematics December 



Greater detail on the content of each subject area tested may be found in 
Interpretive Supplement and Test Content Specifications, booklets mailed to school 
districts. 
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A Word from ihe Kids . . . 

Taking tests may not rank up there with recess, but schoolchildren seem not to be 
perturbed by state testing. In a 1974 survey, teachers of pupils in grades two and 
three reported tliat most pupils actually liked being tested. Grade two teachers were 
typical. They were asked, "How many children enjtiyed taking the test?" They 
answered: none, 3 percent; some, 20 percent; most, 66 percent; all, 1 1 percent. 



Increased attention by the State Depart- 
ment of Education to areas of substandard 
pupil performance'' 

o Identification by the State Department of 
Education of successful practices as models 
for statewide dissemination 

, u Increased public awareness of- problems and 
successes of California schools 

o .Statewide assessment of special programs, 
such as the MillerrUnruh reading program 

• At the local level: 

o Allocation of funds by local boards oC 
education to areas needing great^jr assis- 
tance^ 

o Greater staff attention, sense of urgency, 
and .concentration on areas of ^substandard 
performance by pupils 

u Increased public awareness of problems and 
successes of school districts and individual 
schools and a growing awareness of under- 
lying reasons 

o Availability of reference data for use in 
applications for grants and special program 
funds 

o Use of test results as a means of determin- 
' ing the effectiveness over a period of time 
of new programs or emphases 



^For example, the Ad Hoc Advisory Council o;i Student 
Writing-created by Superintendent of Public Instruction Wilson 
Riles to improve high sctiool writing ability -resulted directly from 
declining grade twelve scores in written expression. 

^In one California school district, low reading scores prompted 
teachers to request and receive funds from their board of education 
for more thorough and frequent assessment of pupils* reading-plus 
additional materials and consultants. In another district, substan* 
dard reading scores led to the creation of a wel!*funded reading 
dcpaitipent. 



~ Use of test results as an aid in reviewing 
specific areas of need with local district 
principals, curriculum specialists, and 
teachers 

The background and most tangible effects of the 
California Assessment Program have just been 
described. In the following section, answers are 
given to some of the most frequently asked 
'questions about the nature and operation of the 
program. 

Commonly Asked Questions About 
the California Assessment Program 

Q. What are the purposes of the program? 

A. In general the program provides broad 
information that may be used to evaluate 
school programs in individual, schools or 
school districts or in the entire state. It is 
not designed to assess the progress of 
individual pupils or to evaluate teachers. 
The program has five main objectives: 

1. Discover the special strengths and 
weaknesses of California school- 
children-at the school, school district, 
and state levels— to aid in improving 
school programs. , 

2. Provide the public with evidence of the 
effectiveness of the educational system 
in teaching basic skills. The public, of 
course, includes such interested parties 
as parents, legislators, taxpayers, and 
empl6yers. 

|3. Help evaluate specially funded^ pro- 
^^"^rams such as liSEA, Titlp I; the Miller- 

Unruh reading program; and Early 

Childhood' Education, 

4, Provide information for research mto 
effective program techniques, such as 
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discovering the characteristics of pro- 
grams of high effectiveness. 

' 5. Improve the educational system by 
allocating state funds most effectively 
to the public school system in relation 
to other recipients of tax dollars, to 
various educationaj programs, and .to 
various parts of the state. 

Q. Are the test results valid? 

A. The design and method of developing and 
constructing the tests ensure their content 
validity. Further evidence of their validity 
comes from several sources: 

1. There is a consistency of results from 
year to year in the same districts and in 
districts having similar characteristics. 

2. In sample tests there is a strong correla- 
tion between results obtained by 
schools on the California tests and on 
other widely used standardized tests. 

3. The background factors thought to 
relate to achievement levels (such as 



those reported annually with each dis- 
trict's results) are generally predictive 
of results. 

Q. Arc the state tests valid for minority children? 

A. Yes. All tests in the state program were 
designed by California educators specifi- 
cally to measure the progress of California 
children. Particular attention was given to 
using questions that are as valid for mi- 
nority children as for all others. 

Q. Do test results reflect the total of a pupiPs 
knowledge andncademic«abilities?__ _ 

A. No. Tlie tests measure pupil progress only 
in basic skills. They do not measure knowl- 
edge in all areas of school study, 

Q. Does the testing program determjne the cur- 
riculum of school districts? 

A. No. Questions are derived from basic sub- 
ject material already under study in »all 
California school districts. Testing affects 
local curriculum only insofar as it provides 



The ABCs of Matrix Sampling 

How can detailed conclusions be drawn about California schoolchildren from tests 
that contain only 20 to 30 questions? The answer is matrix sampling, a testing 
technique used in the state tests for grades two, three, six, and twelve. 

Matrix sampling is a shortcut, but an accurate and valid ane. In it, each child takes 
only part of a much longer total test. A second-grade pupil, for example, takes only 
25 of a total 250 questions in the complete grade two test. (Thus, there are really 
ten different test forms for second-grade classropms.) This matrix sampling makes it 
possible ^to have a wider variety of questions for each grade, thus testing the subject 
more completely. Yet, it does not test any child for too long a time. Statistical 
calculations make it possible to produce results for each school and district as if all 
the students had answered''all the questions on the long test. 

The following figures show the number, of questions to be answered by each 
stuilent together with the number of questions on that grade level's complete test. 

^ Grade two 25/250 

Grade three . 25/250 

Grade six 30/480 

Grade twelve 31/558 

In grade one, all pupils answer all 35 questions. ^ # 

Mow does matrix testing work in the classroom? Each teacltbr's packet of tests 
already has been packaged with the different forms of the long test in mixed order. 
All the teacher needs to do is distribute them from top to bottom for the class to 
receive the proper mix of forms. 
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feedback information 
local improvements. 



useful in itiaking 



Q. Who are tested? 

A. All students in grades one, two, three, six, 
and twelve who are present in regular 
public school classes during the period of 
testing each year. 

Q. Who are not tested? | 

A. Children who are mentally retarded or 
educationally handicapped, certain children 
among those ^yho are physically handi- 
capped, and students enrolled in continua- 
tion high schools. 

Q. Why are first graders tested during their first 
, , month in school? 

A. Tlieir test-the Entry Level Te^r-measures 
the level of pupil readiness for school 
• instruction. It reports their starting point in 
such areas as immediate recall, letter recog- 
nition, auditory and visual discrimination, - 
and language development. The test is not a 
measure of their school achievement; it is 
use^ as a basis of comparison when the 
pupils take the state reading tests in grades 
two and three. 

Q. How long does the testing take? 

A. The tests themselves take about 30 minutes 
for each participating pupil. Another ten 
minutes are needed before and after the 
actual testing period for preparation and 
collection of materials. In addition, there 
are practice tests in grades one, two, and 
three whicluare administered to prepare the 
children for the actual test. 

Q. How can a pupil l^es^ prepare for the test? 

* A. Since the^estV measure a pupiKs develop- 
ment in broad^ubjec't areas, specific study 



or memorization is likely to be of no value. 
As always, pupils should get enough sleep 
the night before testing, have a good 
breakfast or lunch, and listen carefully to 
the teacher's oral directions during the 
testing period. Again, in grades one, two, 
and three, the practice tests play a promi- 
nent role in providing pupils with experi- 
ence in taking a test Jit a time when their 
questions can be answered. 

Q. Are the tests difficult? 

A. Naturally,, they will be seen differently by 
different pupils and teachers. In general, 
however, the average test question is of 
moderate difficulty. Each test contains a 
few very easy questions as well as a limited 
number of more difficult questions. 

Q. May a parent see the test his or her child has 
taken? 

A. Yes. All of the test questions are on file for 
public inspection in the office of each 
county superintendent of schools. They are 
placed on file there each year after the tests 
are given. 

Q. May the testing program be used to evaluate 
teachers? 

A. No. The testing program is designed to 
show results for entire schools, school 
districts, and areas of instruction. It does 
not provide results for individual children 
or individual classes. Because of these 
factors, test results are more likely to 
refiect instruction by many teachers over a 
span of years rather than the efforts of a 
single teacher during the year of testing. 

Q. Who pays for the testing? 

A. The' state pays all the direct costs of 
testing. 
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Resource Material for Chapter II 



What the \ 

Besides providing a general outline for operation 
of the California Assessment Program (CAP), state 
law mandates certain actions by state and local 
educational agencies. The following is a summary 
of the more important requirements: 

Local Boards of Education 

• Must administer annually state tests in grades 
one, two, three, six, and twelve and submit 
completed tests to the state for scoring 
(Education Code sections 5779 and 12823). 

• Must report annually districtwide test results 
at a regularly scheduled .meeting of the 
governing board (Education Code Section 
12826). 

• Must submit annually information on opera- 
tional factors to the State Department of 
Education, on forms provided by the Depart- 
ment, for tabulation and analysis by the 
Department (Education Code Section 12848). 



Education Code Sections on ihe 

Tlie sections of the Education Code that estab- 
lish the California Assessment Program and specify 
the obligations of various state and local agencies 
in the program are the following: 

(CHAPTIR S t. SPtOAl IIIMINTAXY SCHOOL tIADINO iNSTXUaiON MtOORAM) 

(Artkl* 3. Tttting mn4 fro^rvm {v«lw«H*vi) 

r0iffnff of PuplU In Grad9t /, ^ and 3; Notional Normt, Dufhi of Sfof0 
Bocrd of Educollon 

5719, The Slalo EJoard of Kducalion shall rcciulrc each school district lo 
jdmiiijsler uniform tests lo each pupil no> Uler ihjnnis third month of attendance 
in iliK first grade The first-grade entry le\ el test shall ohUin a com^wsilc estimate 
for each pupil of skills related lo learning and inemory. allenlion, \jsual 
IK'rceplion. and audilor> comprehension The answer sheets shall be transmitted 
to Ihv Department of Wucalio.i for scoring. It no published lest is dee.med 
suitable, the Stale Board of Kducalion ma> combine parts ol avai(al)le tests or 
dcvolop a new le^i 

The Slate Haird of Kducalion shall also require each school district lo administer 
uniform lesis tn reading anniiall> lo pupils in grades 2 and 3 Such leils shall be 
rccoinmenucd bv ihe Department uf Education and shall be submitted lo ihe 
Stale Buard of FMutation for approval and adoption If no published lest is deemed 
suitable, the Deparlmenl of Kducalion mav combine parls of available lesIs or 
develop a new lest. An) le^l so adopted shall dc cflualed lo nationally norined lesIs 
«> that the performance of California pupils may be compared to that of a national 
sample The tests which have been approved and adoplc<^ by the board shall be 
printed or purchased and distributed lo the various school di»lricls in the state by 
the Department of Kducation The answer sheets shall be transinilled to the 
Department of fulueali'on for scoring. 

The State Board of Kducation shall develop a testing method that will oblam an 
accurate estimate of statewide performance of pupils in grades 2 and j in reading. 
Inder such a testing method, the Department of Kducation shall determine 
whether pupils in a given school shall be administered the entire test or whether 



Requires 

State Department of Education 

• Must analyze all the results of the state testing 
program and report them to local school 
districts on a school-by-school basis (Educa- 
tion Code sections 5779, 12848, and 12852). 

• Must report annually to the Legislature and 
State Board*^ of E4ucation the distnct-by- 
district results of state testing, including an 
analysis of factors that appear to affect the 
results significantly (Education Code Section 
12848). 

• Must equate tests to nationally normed tests 
so that the performance of California pupils 

• may be compared to the national sample 
(Education Code Section 5779). 

State Board of Education 

• Must adopt the statewide testing program, 
require its annual administration, and provide 
tests to local school districts without charge 
(Education Code sections 5779 and 12823). 



California Assessment Program 

the pupiU jhall be ddmmistered a portion uf the tCit uhith will be reprcNr^iiUtixi* 
of all lest objectiNcs, goals, or categories of items on the entire lest 

The procediTc required by this vt'tion shall bo implemented not later than the 
1975-76 school >ear 

The State Board of Kducation shall determine the form m which the answer 
sheets for the first grade entr> level test ^hall be transmitted to the Department 
of Kducation for scoring, and the form in which the answer sheets for the untforin 
tests in reading for grades 2 .md 3 shall be transmitted to the Department of 
F!(iuvjtion for scoring. 

The State Hoard of Kducation shall anal> ze the progress achieved by third grade 
pupils using thK first-grade entrv le\el test results as a basis for identif>ing 
comparable pupils receiving various kind? of reading instruction 

The State Hoard of fCducatiun >hall adopt rult*^ jnd rtguLilions go\ernmg the 
time, place, and methods for administration of the testing program under this 
article ' ^ 

Pupils tth( have Ik-cu determined to bi nicnlall* ulaidid. a>tKfimd mi lhi> 
C6i\c >hall l>c exempted from Iht toting nnuiriMm ra jni^Hm d h) this chapti-r 

Pupils who ha\( !)oen determmet! bt educat<unall> iKindiLapptd. as diriuwl 
tn this ccxic, shall be subject tu the Itstm^i iajuin nti jit iiniH^ciI b> thi>Lhaj4ti. 
exrent such pupils shall be tcstod separate U from reguLi pupil> Hit DcpartmeiU 
of Education shall anniialK prepare a Lomoaratut anal>>is4/f the aLori*> ur rciulu 
of tests administered to educationally hannicap|X'd pupils and regular pupils Tlie 
Department of K<luCation shall annualU re|xjrt tu the Ixgislatun iU sturi s oi 
results of the tests admmiste red to eduLatu nallv hamliLapind puniis 

The tcsli administered pursuant tu lhi<. artitlt sh.ill \k tih|jlu)cd to dett rimm 
rarh nhtjol district's quota ufiptLialbt rtadii^ leaihi't>.as rt quHid In ArtitU 4 
fcominencing with Section 5781) of this chapter 

Commencing with tests aJiiiinutennl m thi 1972-1973 sLh^n^I uar. M.hooI 
districts shall subiint answer ihet U aiid rt !ati-d pupil inforiiutiotk on a |k i H.luMii 
basis 

I The corresponding .sccUun number in the new (reorganized) 
Hducation Code (effective April 30, 1977) is Section 60640. The 
new section nuMbcr for each of the IMiicatiun Code sections 
oontaincil in this resource niatcnal for Chapter 11 is^ivca ui brackets 
at the end of each sectton.) 
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Scores, Use. fncU'sion in Pupil's Records 

ollV^l S uk« s for iiiciiv idu.it jHipiU uit tlic ftr^i >;iaJt' i'iih) 
level »osl sli nol be usiul l»v nhtiol (iistnct:) or tenchei^ for 
induichi.i! ur pl.ui inciit (»r as a Im*>is for .tM> otiiei 

decisions vvluch \\ouU\ afleel llie pupil's clerneiilary st hool 
experience. S< t)res from this h-sl slitll ttot m an> manner l>e 
included on llio pupil\ unnulaUve seliool leeoid 

The Stale lUiaul of Kdtitaliuiiili.tll detfrnuiH' winch, if an\ . 
of tlir K'ori'N .ttt«»niud ity papiK on the t<'Sts adniinistcret.i m 
giadt ^ 2 and 3 nia> be riLtjuK'd un the pupd\s Laiiiulative 
schooS lecoid. 

[New Hdncation Code Section 6064 1 ) 

Report 

5779.3. The State Board of l»ahication shall direct each 
school district to report annually its inethods used to assess 
pupil ptjrforinancc in ruadnn; dnnns grades I, and 3 I he 
bepartnjenl of Kducation sliall assist the seiiool districts to 
iinprov.* thoir local pro^'jains of assessing pupil performance 
in readkxi^;. 

(New hduealion Code Scelion 6U642| 

R^m^dtal R^ad^rt* Scofs; Evaluation of Rtading Program; Reporf to 
l0gftlatur0 

5780 The scores of tesU provided pursuant lo SecUon 5779 of Iho^e piiplii m 
grades iwo and three who have participated in a reme<lwi program shall be 
itiaiutained and treated separately 

I- rum a stud) of thi rtMiTt> of thot' U>t> lu JistnUs v\hich Luiulmt rf-b.t>.u 
reading program pursuant to this chapter, and the test results in districts which 
do not conduct such a prograii). the Mi{)crintendent of Pubhc histruction shall 
evaluate basic rcadir.g programs. and he shall repoU hisfnidin^^s annually tu tht 
State Hoard of Kducation, ^ 

The State Board of F^ducatiun shall report its niulings regarding tlie 
implementation of, and experience under, basic reading programs, together with 
an\ recommendations for any adjustments in the program, to the legislature at 
each regular session This »ep6rt and the re[>ort required pdrsuant to Sectioi) 12848 
nuv be consolidate<l into a single annual report 

[New I-ducalion Code See lion 60643) 

Grade Specification Changes 

5780.1. ExccpL for tlie first ^rade entr> level test rcijutrcd 
by Section 5779, tlic State Hoaui of Education may icplaee the 
grade speuiftcalion for the .idininistration uF specific tests 
pursuant lu this article \vith a .spceiftcttiou uf age or tunc 
elapsed since the pupil entered school wheie such a 
speciflc.ition is more tun^islent with patterns uf school 
orj:ani7ation. - 

'1 he IX'partment of l£dii( atioii shall snhnut a repot t to the 
Joint l/egtslative Bud^rl Cuinnnttce expL^ nni^i the reasons 
for r«.'plaein^^ the ^^jrade spi cification. I he leport .shall be 
Mil autted at least six months prior to any stich change. 
[New hdueatioii Code Section 60644] 

CiiAPTEii 9. Scrrooii Tt:3TiN*o 
Article L GcncrallVovibions 

S/iof/ n/fe 

12^>20. This chapter may be cited as tlie CalifDrnia School 
TcstiiiK Actof 19C9. 
|New hducalion Code Section 60600| 

Legislative Intent i 

12821. It is the inteitt of the I^j»islature iit eiuietniR this 
ch.ipter tu d^w'tLrniiiK tht i ftccttv culss of SlIiooI dij>tiiLtsS and 
schools in assisting f)upils to master tlu* fundaineiihtl 
educational skills towards which insl ruction is directed The 
program of stalewide testing snail provide the pnhlie. the 
Ixgislatur.'. and school districts evaluative inforniation 
rcgardiitg the various levels of proficicnc) achieved hy 
dufercnt groups of pupils of varying sotiiiucouoi<ut 
backgrouno:. so that the I,cgislaturc and individual scliool 
districts -may allocate educational resources in a inaniu»r to 
assure the maximum educational opportuni^v fnr al! pupils 
The program of statewide ttstiiig shall identify unu,uul 
success or failure and the factors vvliith appear to he 
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respoiiMble, so that auproiniate action may be taken at the 
distrii t and state level to ot.tain the highest quality education 
for all public school pupils. 

[New Education Code Section 60601 ) 

Prohibition of Scholastic Aptitude Testino 

12821.5. No School district shall aJininistcr, in eonncetion with 
the statewide toting probata, or otherwise, an> standardized group 
tcNt which provtdi^N or atteinpt> to provide .i snigle measure of 
general seliola.>lic aptitude of a pupil, to aity pupil or yroup of 
pupils it) »he di>trtc(, cxeepi: 

(a) A sehool district may administer or allow to be administered 
veholaNtie aptitude tests for plaecntent in speeial educational 
programs lor mentally gifted minors provided pursuant to Article 14 
(eoiiimencitig with Seetion 6421) of Chapter 6 ot Division 6 or in 
postsccondary edueaUon or lor the purpose ot' detcniiining cligi- 
bility of students for scliolarslitp awards, grants, or other awards 
relating to po.siseeondary edueation. 

(b) A Kehoo! district, with the prior approval of the Superintcn« 
dent of Public Instnietion, may administer group scholastie aptitude 
test.s for reNeareh purposes, provided, that the district has a 
Superintendent of Public hiMruetion approved group testing plan 
whieh ineludes: 

(J) A current schedule of testing; 

(2) A slalenienl of purposes of the uses of the tests; and 

(3) Provi.>ions tliat^ sueli tests are administered and the results 
interpreted under the dtrecl >uperviMon ot a quahficd school 
psychologist, psycho me tnst. or sehool counselor, 

[New Lducation Code Section 60614} 

Definitions 

12822. As used m this chapter: 

(a) "Achievement test" means any standardized test 
which "^ensures or attempts to measure the level of 
jxjrfonnance which a pupil has attained in one or more 
courses of study. It shall include (1) tests in basie skills courses^ 
administered annually and (2) tests in content courses 
admuusteud fioin tnnt to time as designated by the State 
Board of Education. 

(b) "Pii)si<al peifoiiiiaiici te.st** aneans any te.sl vvliich 
hu asuu > oi alii iii{a.> lutasure the phvsual fitness of a 

I^'^l^'* ... 

(i * 1 1 >Uo^, prt>iU.aio int. ans tin.' s\ ^lematK achievement 

testing of all [)iipils m grades G and 12, and the physical 

perfuiui.tii. < t< ^lni>. of all pjpils m any thicc grades 

di siA.oalt d l*\ ih^ Suilv Hoard tJ" J ahicat itui, lequiied by this 

chapU'i m .ill si^houK wilhm t.ali m hool district h> means of 

tests d. M^.naU<l b> tin State Huaid of KdiKatioiu 

(d) "IJa^n skills courses" nu aiis those snhjticts vvhicli 

involve, .I'l.ong other *"kiliN, memorization and master v of 

specific limctions, including hut not limited to, reacnng, 

spelling l):l^:e mathematics, and effectiveness of written 

exi)ression 

(c) "Clonlenl courses" means those subjects vvhieh recpiire 
the mtegiation of factual matter, logical analysis, the solution 
by the studt'iit of posed prol;lems, and the coiiimunieation of 
icieas, ineludiin;, but not limited to, literature, history, 
advanced mathematics, and seienee. 

(New i'duealion Code Section 60602] 



Dutt0$ of Stat0 Board 3f Education and Deparim»nt of Education 
1282.1 1 \\v St.ite Ho.ird of Kducation diall 
.i Hujuirt .i testing progr.«iu in all school districts 

b Hcqtiirt' the Dcparttnent of F^iucation to submit and rcconiinend 
.irhtex nnent teMs to the State W ard of Mucation for appro\ al and adoption I he 
adwpU'd u■st^ shall 1)0 printed ur |Hirchased and distributed t<i the various school 
il»vtr<('ts Ml the itate b) the Depaitrnent of Wucalion 

i ' .staU IK/ardui KduL.i(K>n shall deselopatestitiKiitethiKl that uilU>btain 
t,. IV* ^a.iU i >tiniatc uf statewide jJorfuimancP. school district j)orformance. and 
v\ jHvforniancP of pupils in grades 6 and 12, in basic skills courses 

I nder siirh a testing method, the Department of blncphon ^hall annually 
r«sit)tr( (h.it each distrut administer a statewide test to all pupils in grades 6 and 
i» iiit dtparuiit'Mt ^hali determine uhithcr pupils m a guen schiwl shall 1)€ 
<Uifiii(i>u u il tlu t'lairt' li'^t «/r u hethi r tht pupils shall U administered a |X)r(ipu 
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of iho lost \^hich will be representative of all the test objectives, goals, or catogones 
of iioms on the entire test 

The procedure required by this section shall be implemented not later than the 
197S-76 school year 

J/ Designate thi ph>sKaI performance test tu be used dunng Xhi ensutng 
school year 

<er Adopt regulations for the conduct and administration of the testing 
program 

(New fcducation Code Section 60603) 

Tcsf Dcvchpmcnf, Pubtkollon, and Admlnlsiraflon 

12824. The State Board of Kducation may develop, pul?- 
lish, and adnniiister tests of its owii demising, and the board 
may utilize the expert services of any persons or groups of 
persons in publie or private employment. 

(New tducation Code Section 60604) 

Conducf of Tcsfing Programs 

12825. The governing board of eaeli district .shall, in ae- 
eordaiice with tlie rules and regulations of the State Board 
of Edueatioii, eonduet a testing program within the district. 
The governing board may also adniniister otner tests. 

(New Kducation Code Section 60605) 

Croup Tostmg of Students from Foreign Countries: Limitations 
12825.5. No group test directed to aseertainiiig the 
intelligeiiee quotient of a pupil, cxeept intelligenee tests 
administered on an individual basis for the purposes of 
placement in ^pceial education programs, sliall be giveii to 
any elementary or seeundary pupil who has eome to the 
United States for the first tmie from a foreign eouiitry m 
which English is not the primary language until suc-li student 
has resided in the United States for*.two years. 
|New Education Code Section 60606) 

Scoring; Htfi^is of R9$ultt 

12^^26. The >;ovcrinng Lujni uf tach si-hujl district shall 
report on a ic)iool-b>-seliool ha:»Js to the Department of 
Kaueation, pursu.uit to rules and icguhitioiis adoplod by tlie 
State Hoard of rulueation, the results of llie aehicvcmrnt tests 
administered pursqant to this ai tiele 

The distriotwide resuhsof the testing progra'n, hut not the 
scoie Of relative poM'tioii of individual pupils, shall bt? 
reported to the Juverning bviard of the district at least once 
a >car at a regularl> scheduled meeting. 

(New r.ducaticn Code Section 60607) - 

Pfiysicoi Performance Test Administration and Results 

12827, Outing thither the uhHith of March, ApriL ur May, 
the governing bv^ird uf each schoul district mauitaming any 
grade designaU d by the State Huard of llducatioii pursuant 
to subdivision (c) of Section 1?^.22 sliall administer to each 
pupil in those grades the physical performance test 
designated by the State Hoard of Kducalion. hach pliysicaliy 
handirapped pu|)il and each pupil who is physically unable to 
take all of the physual pcrfuriiiancc test shall be given as 
much of the test as his condition will permit. 

Upon rcciuest of the Department of Ixlucatioii, a school 
district shall subiilit to the department at least once c very two 
years the results: of its physical performance testing, 

(New Kducation Code Section 60608) 

Coopcrafion in Carrying Out Program 

12828. At the rcqu^'St of the Slate Board of JOducatwii, 
and in accordance with rules anil leguLitlons which the board 
may adopt, each cou ty super intcndont of schools shall coop- 
crate with and ^\\c assi^st.iiii^c to sJiuul districts under las 
jurisdiction in carrying uut the testing progr.int:> of such dis- 
tricts and other duties impuscd on school districts by this 
chapter. 

(New Hducation Code Section 60609) 



Preparation for Tosfs 

12829. With llic cxr^-ption of physical performance tests, 
no city, county, city and county, or district superintendent of 
schools or any principal or ttachcr of any clcnicntary or sec- 
ondary school under his charge shall carry on any program 
of specific preparation of the pupils within the district for the 
testinp^ program as such or the particular test used therein. 

(New Education Code Section 60610) 

Consiruclion of Ad 

12830, No pronsion of this chapter or Article 3 (eom- 
mciieing wilh Section 8571) of Chapter 3 of Division 7 shall 
be construed to mean, or represented to require, that gradua- 
tion from a high school or promotion to another grade level is 
in any way dependent upon successful performance on any 
test administered as a part of the testing. program. 

(New Education Code Section 60611) 

Grades 6 and i2 Acbiovoment Test Results 

12832 The State Hoard of Education shall dctennine 
which, if any, of the results attained by pupils on the 
aehievcnicnt tests administeicd in grades 6 and 12 may be 
recorded on the pupiPs cnmiilative school record. 

(New Education Code Seciion 60612] 

Grade Specification Replacement 

12S33 The State Huard of Hducation may replace the 
grade specification for the adminiitratioii of sjicciHt tests 
pursuant to this article with a spccificatiun of age or time 
elapsed since the puj^il entered schovjl where such a 
specification is more consistent with patterns of schuol 
organization. 

The Department of Kducation shall submit a report to the 
Joint Legislative Hudget Coiniiiittee explaining tne reasons 
for replacing the grade specification. I^he report shall be 
submitted at least six muiiths prior to aliy such change. 
(New Education Code Section 60613) 

Article 2. Content Course Evaluation 

Cdnfenf Courjo EffccfivQncss 

12840. From time to time, as the State Board of Educa- 
tion iiiay determine, the board shall conduct studies of the 
cfrccli\encss of the various content courses offered by the pub- 
lic schools of this state. Such studies shall include details of 
the specific objectives of the courses and the level of achieve- 
ment attained by sludeiits enrolled in such courses and, for 
this par puse, the board iiia> use the results of any test ad- 
minlslered under the provisions of this chapter. 

(New Education Cude SfTdtion 60630) 

Rcpori /o Governor and icy'ataftjrc of ${o1c CoatJ of EducoHon^s 
Findingi and Rcconimcndailcns 

I2^n. L'pon the couipl' ti»a* of a study by huard pur 
suant to Section 12SJ0, the Loanl shall nport its findinfrs, 
and rccomiatiidaliuiis, if any, to tla Cu\ciu.>r and the L'-'gis- 
laturc hut late: than Janu.iry 1 of the yeir sutci'tding cuiia- 
plcticn of the study. 

(New Educiition Code Section 60631 ) 

Reports to Ler^isloture; Contents 

128't2. hi making reiH)its to the Lcgtslatiiie pursuant to 
Scctiuii 1 2841, the Inurd shall maintain the .monymily of all 
individual students in\ol\» d. The board may nuke analyses 
involving uthcr factois, iiu hiding, but nut hmiled to, general 
categoriL.s c*f peda^;o>4ies in use, type of chstiut urgain/ation, 
geographic aiea, .socioeconomic data, ji/.c ofsi iiool districl, or 
other analytical items which may prove useful. 

(New Education Code Section 60632) 
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Cooperof/on in Ccnying Ouf Program 

12843. The covcriiiiij: board of any school dibtrict shall 
cooperate fully with the State Board of Fduwtion in making 
its sehools available for studies; provided, that the State 
Board of Edueatioii shall provide all ncecssary materials and 
eoasultant serviecs free of ehargc to the district 

(New Education Code Section 60633] 

* 

Federal Funds 

128'H. The ^^tate Board of Education may accept federr.l 
or other funds for the purpose of financing studies under 
this article. Such studies shall be conducted by the board on an 
ad hoe basis, and the board may utilize the expert services of 
any persons or groups of persons in public or private em- 
ployment. 

(New Education Code Section 60634) 



Article U Testing Evaluation and Analysis 

Annual Report ol^Sfafe Department of Education to 
Legislature, the S^ate Board, and Bach School District; 
Contends 

12848. The Department of Education shall prepare aiid 
subinu an annual report to the I^gislatuie, the State" Board 
of Education, and to each school district in the state 
cx>ntaining an analysis, on a distnct-by-distnct basis, of the 
results and test scores of the testing program in basic skills 
eourses, niduding tests administered pursuant to the 
MiUer-Unruh Basic Reading Act of 1965 (Chapter 5.8 
(commencing with Section 5770) of Division 6)^. The report 
shall include an analysis of the operational factors that appear 
to have a signLficant relationship to or bearing on the results. 
The cinal>sis iii.t> include, but need not be hntited to, the 
ioUov.'ing facto I i": 

(a) Demogtaphic charactensties. 

(b) Financial characteri'^hos. 

(c) Pupil and parent ehai-iuteristics. 

(d) Instructional and stafl charactcTislics. 
(ei Si)ecia!l> funded pri>gr«jns. 

Scnooi districts shctll siibiint to the Department of 
Education whatc\eT infonuation the department decin^ 
necessary to carry out the provisions of this section. 

(New I-dueation Code Section 60660] 



Consolidation of Reports: Single Annual Legislative Report 

12848.5. The report to the Legislature required by Section . 
12.^8 and the report to the legislature required pursuant to 
SectiJn 5780 may be consolidated into a single annual report. 

( New education Code Section 6066 1 1 

RtzommondoWom io ihc Lcgishiuro ^• 

128'19. The State IJoard of Education shall make reconi- 
nicndation to the Legislature as the board deems appropriate 
eonceriiing appropriate or necessary Icjcislation with respect 
to the rcbtiUs of tlie Icstj »g projjram and the evaluation and 
analysis thereof required by*this chapter. 
[New hdueation Code Section 60662) 

Siudy and Reports Concerning New Tosfs 

12850. Whenever the State Board of Education designates 
a new test to be administered under this chapter, the Depart- 
ment of Education shall study the compatibility and test results 
of the new test and existing: tests and shall annually, report the 
results of such study to the Legislature at the same time it 
submits its report pursuant to Section 12848*___, 

(New Education Code Section 60663] 

Study of Selected Schools 

12851. The Superintendent of Public Instruction shall 
perfoini an anal>iis of selected sehools to identif) educational 
factors which produce the distinction between unusually 
high pcrforuiing districts and unusually low performing 
district.s, such perforipanee as measured by standard 
measures of school achievement. 

1 he schools selected for stucly shall be comparable in social 
and .demographic characteristics and shall vary only on 
student attainment. 

The study shall last two calendar ycars^ so that variables 
discovered the nr.st year ma> be verified the second year. 

The Suuennljtindent of Pubhc Instruction shall report to 
the Legislature by January 5, 1975, on the identification and 
descriotion of those socioeconomic, financial, and educational 
variables affecting school performance which lend to 
distinguish between unusually high-perforining districts and 
unusuall) low -performing districts. By January 5, 1976, the 
Superintendent of Public Instruction snail issue a final report 
to the LciTtsIalnie including information regarding the 
veriHabihl) oftlu iclati\c unpact of the \ariablcs discovered 
during Uie first >car of the .study. 

(New Education Code Section 60664J , 
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The Annual Timetable 



For purposes of an orderly dissemimtion of test results, no school district shall present 
districtmde results of the testing program to the governing board of the district or release them to 
the general public until the statewide residts of the program have been presented to the State 
Board of Education at a regidarly scheduled meeting, 

California Administrative Code, Title 5, Education, 
sections 1026 and 1060 



Fall is the busy season for testing coordinators. 
As shown on the time/event calendar, the previous 
year's state assessment results arrive in the fall for 
compilation, reporting, and evaluation. In addition, 
the new year's testing begins shortly after the first 
school bell rings in September, 

The wise testing coordinator has a plan. This 
chapter (1) provides information on the state's 
timing in sending test materials during th'-ee key 
months—September, October, and November; and . 
(2) sets the stage for the presentation of material 
contained in the rest of the handbook: 

How to interpret test results (Chapter IV) 

How to use test results for improvement (Chap- 
ter V) 

How tor*;report test results to the board of 
education (Chapter VI) 

How to report test results to the media (Chapter 
VII) 

How to report test results to staff and commu- 
nity (Chapter VllI) 

... all of which principally take place during these 
three weighty months. 

Materials from the Stale 

Later .in this chapter, we review the first stepr 
commonly taken by school districts when they 
receive test rcsultb m the fall. Firt>t, however, let us 
look at the individual pieces of material arriving 
from the state at that time. 



School-Level Report* 

The school-level report is presented as a com- 
puter printout on a preprinted two-page form. A 
school district receives duplicate two-page forms 
for each grade level tested at each school (except 
the rcbults for grades two and three, which are 
combined in-.one report). The report gives detailed 
results for each grade level tested. Comparisons can 
be made within the district and with statewide 
averages. 

Interpretive Supplement 

Interpretive supplements are provided in booklet 
form to give detailed assistance in interpreting the 
school-level report previously described. Three 
separate booklets are published for grades two and 
three, six, and twelve. 

Profile of School District Performance 

The profile is a one-page computer printout on a 
preprinted form. In the top half is contained a 
summary of the districtwide results for each grade 
level and each content area, and the district score is 
shown in comparison with the rcorcs of other 
districts in the state. The lower half of the sheet 
contains a report on various background factors in 
the district and a comparison of the factors with 
those in the rest of the state. The background 



Test resulfs rc caved ri. September and October may not be 
released publicly until Ihc No/e; ibcr meeting; ut (he Slate Hoard ot 
Lduuittun. Under a 1976 itiu'iificatiun ut the California Adniinistra- 
tlve Code, however, school district superintendents may share this 
mformatron informally wuh their boards of educatron and sXuU as 
j;oon ns it arrives from Sacramento. 
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Scoring, evaluation, and pybUshing 
of results for all grades takes place. 



Interpretive Supplement 
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Profile of School 
District Performance 
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A Guide to Interpretation 



Student Achievament 
in California Schools 



factors included arc in addition to the factors used 
10 compute the comparison score bands. 

Profiles of School District Performance-^ 
A Guide to Interpretation 

The guide is a 26-page booklet that provides a 
considerable amount of information on the individ- 
ual tests and the testing program itself. It explains 
how the tests were developed, what they measure, 
hoNV they are administered, and how the test 
results and background factors are organized in the 
district profiles. The guide is necessary to under- 
stand how the various numbers, scores, and values 
jare derived. 

Student Achievement in California 
Schools: Annual Report 

The 60- to 70-page annual report presents and 
analy^ces the statewide performance of California 
schoolchildre;;^on^ tests administered during a 
school year. A new report is issued each fall on the 
previous year's results. It contains three kinds of 
informatiQn: 



1. Analysis by the assessment advisory commit- 
tees of skill areas where pupil performance 
was notably strong or weak 

2. Test performance of various subpopulations 

3. Comparison of California achievement levels 
with national norms 



A Few More Details 

Most other testing events during the year are 
easily understood. A few words are in order, 
however, about the circumstances surrounding the 
reporting of test scores to the State Board of 
Education and members of the Legislature, 

o First, the State Board. The Board meets^ 
monthly (except in August), rotating its meeting 
site among the major cities of California usually 
Sacramento, Los Angeles, San Francisco, and San 
Diego. Board meetings regularly span a Thursday 
and Friday. The November meeting at which test 
results are reported'-is usually held in Sacramento, 
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with the state assessment report usually scheduled 
for Thursday morning. 

Each State Board member receives three docu- 
mertls: (I) Student AJiievement in California 
Schools, Annual Report, (2) school district profiles 
for all districts in the Board member's home 
county; and (3) Profiles of School District Perfor- 
mance. A Guide to Interpretation. The Board as a 
whole receives one set of all district profiles. 

As soon as the report has been made to the State 
Board, local districts are free to make public 
release of their results in their own communities. A 
district, then, actually may release its results on the 
same day as the State Board meeting. 

o Second, the legislators. Soon after the $tate 
Board meeting, each member of the California 
Senate and Assembly receives an annual report and 
thQrdistrict profiles for all districts in his or her 
legislative district along with a Guide tp Interpreta- 
tion. 



Information for the Public 

The major news media already have been keyed 
in to the report of test scores. Details about how 
this affects your district may be found in Chapter 
VL 

News reports often generate requests from the 
public to ihe Department of Education for por- 
tions of the test results data. The Department 
honors all requests for school district profiles (and 
sends with them the necessary Guide to Interpreta- 
tion). However, requests from the public for 
information about individual .schools are referred 
to the appropriate district office. Although this 
information is public, the number of schools in the 
state and the length of the school reports render 
their reproduction unfeasible. Moreover, by con- 
tacting district offices, interested members of tl;e 
public can receive more completennformation than 
that revealed on the assessment reports. Inquirers 
can discover what special progranis-mentally 
gifted or ECE, for example are conducted, together 
with such matters as course offerings, classroom 
organisation, and other local program characteris- 
tics not identified in the sdiooj district profiles. 



The Steps iMost Districts Follow 

How do testing coordinators handle the arrival 
of test scores? The California Assessment Program 
surveyed school districts in the spring of 1970 to 



chart the typical flo^v of testing information and to 
uncover impediments. 

The following is an anatomy of what commonly 
takes place. It is meant not to be prescriptive but 
simply to show what.pthers are doing. 

The Test Coordinator 

In each district one person is charged with 
overse^mg the testing program from the receipt oi' 
the tests through the interpretation of results. The 
nature of that person's job, of course, varies with 
ine si/e of the district. In larger districts the person 
miglit have the title of director of testing and 
evaluation or assistant superintendent for instruc- 
tion. In small districts, the testing coordinator is 
often the superintendent-principal. In neariy all cases 
the coordinate- performs many different functions. 

1. Preliminary Report ^ 

Assessment results fboth in September and 
0 ober) are mailed to the district superintendent 
and directed to tlie attention of the director of 
testing. Once received by the superintendent, th\3 
results are usually turned over to the test coordina- 
tor with a request for an abridged preliminary 
report. 

The superintendent needs to be told the high- 
lights of the results to avoid surprise or unexpected 
difficulty. The preliminary report should also call 
attention to any dramatic changes from the previ- 
ous year's scores, especially declines. The report 
usually takes the form of a one-page summary of 
the results for all school so that any problem 
schools or subject areas can be spotted immedi- 
ately. Although high scores are important, too, the 
superintendent is interested at this point in getting 
ready to ir.eet problems. Chapter IV contains 
suggestions for the testing coordinator on analy/,- 
iiig the results for a school*br district. The report 
completed, the testing coordinator briefs the super- 
intendent )n the highlights. 

2. First Principals' Briefing 

The superintendent convenes the district admin- 
istrative council, which usually includes central 
office administrators and all principals. Cadi prin- 
cipal is given one of the two copies of the results 
for his or her school (the other being retained in 
the district office) and a copy of the accompanying 
Interpretive Supplement. (If principals do not have 
them, it might be useful todistribiite copies of the 
three Test Content Specifications booklets. Ladi 
district received a set of the specifications last >ear. 
Additional copies are available for purdusi.* 
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through the Department of Lducatioirs Publica- 
tions Sales.-) Beskles reviewing the results, the 
Loordniator reports any further information 
received from past regional meetings with members 
of the CAP staff. Principals are given one or two 
weeks to absorb the information before a second 
meeting is hekL 

Districts vary as to whether a principal at this 
time sees how his or her school compafes with 
others in the district. The school report each 
principal receives, however, enables a principal to 
compare that school's results with those district- 
wide. Districts differ even on the time at wh'ch this 
material is given to ^ <ncipals. Although reports 
arrive in September, many testing coordinators are 
reluctant to give them out then, fearing informa- 
tion leaks before official release. 

3. Second Principals' Briefing 

Testing coordinators use alternative methods tu 
help principals understand and use the results. The 
first method is to visit each school, ;vie\ving with 
the principal his or lier school's results and 
planning what action, if any. may be tnkcn as a 
consequence. The second method is to meet again 
with the administrative council, at which nieethig 
eacli principal summari/.es the school's results and 
"defends" his or her findings. Other principals play 
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P.O. Box 271. Sacramento, CA 95802; phone; (916) 44M261 or 
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the roles of questioning parent, skeptical teacher, 
or doubting board member. Such a confrontation 
is not for the timid, but the pruicipal needs to be 
ready to answer sucl. questions sooner or later. 

At this meeting the coordinator can offer to be 
present when principals explain the rcrults to their 
faculties. This meeting often provides the tipoff as 
to whether the results will be used successfully for 
assessment or will -gather dust. A principal unsure 
of the meaning of the results will face a faculty 
with reluctance. Therefore, for any use of results at 
the school level, it is important that th^e principal 
understand them thoroughly or have ready access 
to someone like the testing coordinator, wl.o does. 

LiKcwise, the coordinator can offer to help with 
presentations to parent and community groups. 
Some coordinators put together multhiiedia pro- 
grams and show them at meetings around their 
communities. They integrate tes^ results with 
information about existing successful district pro- 
grams. "Test results," one o ordinator reported, 
'\ire best friend we have. High scores can be 
used to illustrate the succesi^ of a program. And 
even low scores can be used to document the need 
for chaiiije." 

4. Report to the Sdxool Board 

The testing cuv^rdinator is usually the person 
wiio makes the required annual report of the 
district's series to the local board of education. !n 
addition, to districtwide scores, about two-thirds of 
the districts also report school-by-school results to 
their school board. 
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Interpretiijg Test Results 



This chapter contains information on making 
the best professional use of test results. It gives tips 
on how to understand scores fully. Then Chapter V 
outlines sone steps for translating scores into 
program improvement. 

This material does not require advanced knowl- 
edge of education or statistics. It assumes only a 
general knowledge of the .California Assessment 
Program (CAP) and some basic unde^canding of 
statistics things like means and correlation coeffi- 
cients. 

Becoming Familiar with the Statistics 

In any analysis of data, the first task is to 
become familiar with the terms. Later, we will 
delve mto some of the fine; points of test result 
figures included in your reports. Now is a good 
time to be sure that you understand how these 
figures are reported. 

One way to do so is to look carefully at a CAP 
school-level report for any grade, along with the 
Interpretive Supplement One can.page through the 
supplement, substituting the actual figures from 
your ov/r report. By the time you finish, terms like 
percent correct score and percentile rank should 
have genuine meaning for you. 

Checking the Results 

Now the actual use of test results can be 
considered. The first question asked by testing 
cooidinators is whether the results are correct. 
Errors in testing and reporting are rare, but they do 
happen. Tlie consequences of error are j great 
that it pays to spend a little time verifying the 
scores* 

Some errors can be uncovered quickly. A testing 
toordmator would look curiously ut <i sufficiently 
large (say, 60 pupils per grade), high-acliieving 
school that scored at the 75th percentile this year 



in grade two reading, the 69th percentile this year 
in grade three reading, the 81nd percentile last year 
in grade six reading, but at the 25th percentile this 
year in grade six reading. The report could be in 
error. A bit of simple detective work here might 
save the embarras.sment of issuing and then having 
to retract a report. 

Three things can be done quickly to uncover 
errors. First, one can look at the reported number 
of pupils tested. If the number does not agree with 
the' records for. the particular grade, immediate 
evidence exists . that the scores are probably not 
yours. 

Large and unexpected changes in a grade level's 
scores ought to be verified. There are two fast ways 
to do so. One way is to talk to the teachers 
involved, asking them indirectly how well they 
thought their pupils did this year. It well may be 
that the teachers feel that there was an unusually 
- large number of low achievers at that grade level, 
tnus accounting for a significant drop in scores, if 
the teachers do not feel so, however, you have 
additional reason to be suspicious. 

The second way to uncover errors is to compare 
new scores with past results. For instance, three 
years ago this year!s sixth graders were in grade 
three and four years ago were in grade two. Test 
results for those years should be compared gener- 
ally against the new scores. (For help in locating 
those old results, telephone a consultant on the 
CAP staff in Sacramento at 916-322-2200.) Of 
course, if you know that the general achievement 
level of your schools has gone down in the last few 
years, it may not be useful to compare the new and 
old scores. But if it hasn't changed much and the 
new, lower score still can't be explained, it is time 
to look at other standardized test results your 
district may have at that grad.e level. Even if the 
norms on such testing are not directly comparable 
to those used in the California Assessment Pro- 
gram, general comparisons can be made. 



Tlub chapters section entitled '^Comparing Test 
Scores Longitudinally'' contains advice on compar- 
ing results of dissimilar tests. Or this year's grade 
six results can be compared generally with last 
year's grade six results. If this examination still has 
not explained Jarge changes in achievement levels, 
one should call the CAP office in Sacramento. A 
consultant there may be able to help solve the 
problem. 

The chances of receiving correct scores, how- 
ever, are quite high. In its short life the CAP has 
issued more than 25,000 school-level reports. Of 
that number, about 100 requests to double-check 
results have been made, and fewer than a dozen 
instances of error have been found. Nevertheless, 
the importance of reporting accurate scores jus- 
tifies a close look at your results. 

Answering Common Questions 
About Test Results 

When you present test results, some group may 
find reasons for doubtmg them. Human nature 
benig what it is, people tend to reject results 
completely when they can find any flaw in them. 
Your bemg able to explain uncertamties will aid 
the process of accepting and then using the results. 

Some objections really can't be answered, how- 
ever. Teachers sometimes react to low scores by 
thinking that the score would have been higher if 
they had administered the test better. They often 
ask what the score would have been if they had not 
varied from the prescribed test-giving procedure. 
There is, of course, no way of knowing. 

Most uncertainties, however, can be cleared up. 
The following answers show typical ways in which 
the testing coordinator can provide this useful 
information. Most of these examples contain data 
from the grades two and three Reading Test 
because of greater experience with them As 
studies on the grades six and twelve Survey of 
Basic Skills are finished, similar information will be 
distributed. 

Here are answers and analyses for nine typical 
questions: 

/. What is the reliability of the test'^ 

Reliability can be viewed in several ways. One 
way is ihe stability of results over time. The 
^ section in this chapter entitled "Comparing Pupil 
Norms to School or District Norms" contains 
detailed information on this topic. In sununary, 
the matrix-sampling Reading Test now used pro- 



vides far more stable results than does the Cocpera- 
tiiL Primar\ Reading Test formerly used b> the 
state. 

Reliability of results can also be viewed as a 
coefficient of internal consistency frequently 
called KR20 or coetTicient alpha. That is, if a 
student gets one item correct, does he or she also 
get the next item correct and ultimately obtain a , 
high score on the test? On a pupil basis, the KR20 
for each form of the present Reading Test is at 
least ,85. I'or the full test -all 250 items- the 
estimated pupil-level KR20 is .99. The coefficient 
alpha for school-level results (the most appropriate 
statistic, since pupil-level .*-esults are not reported) 
is .99. By any standard, then, the reliability of the 
Reading Test is extremely high. Similar resnlrs can 
be expected when such statistics are computed for 
the Survey of Basic Skills tests. 

' 2. I low were the tests developed? 

All tests in the state program were developed in 
the same way. First, advisory committees were 
tbrmed to help the Department's Office of Pro- 
gram Evaluation and Research determine the test 
content. The committees reviewed the frameworks 

^ in each subject as well as instructional materials 
and objectives provided by school districts. They 
chose the program objectives common to most 
instructional materials and district curricula. These 
objectives were arranged in content areas, and skills 
were defined i'n each area. The objectives and skills 
were printed in n preliminary dociuiient, which was 
reviewed by a large number of districts in the state. 
After modifications, the objectives were printed in 

^Jhe Test Content Specifications booklet series and 
became the blueprint for the development of the 
tests themselves. These booklets are available in 
each .school district office. 

Test questions to match the Test Content 
Specificatwns were - collected either by leasing 
existing questions from commercial publishers or 
by writing and field-testing questions locally. Com- 
mittees of teachers reviewed .the questions for 
clarity and appropriateness and passed them on to 
linguists tor screening for bias. From the pool of 
Items that passed these tests came the final ques- 
tions included in each test. 

The Teacher's Manual and Examiner's Manual , 
give more detail on the development of each test. 
Its content, and the persons who served on the 
advisory committees. 

J. yire the tests valid? 

No lest is pcifcctl> valid. Lver> testing situation 
contains sonic aspect making the test less 'than 
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perfectly valid. The real question to be asked is, 
"Are these tests more valid than any other tests 
that could be used for measuring the attainment of 
basic skills by pupils in California?" The answer, 
unequivocally, is yes. 

No test can be valid unless it is reliable. In the 
previous question 1, the tests' high reliability was 
described, and in question 2 it was shown that the 
tests were designed specifically for measuring the 
performance of California students and the goals of 
California schools. The entire test development was 
concerned with the unique problems of measure- 
ment in a state as vast and diverse as California. 

4. Why are test results for individual pupils not 
reported? - 

Even under the former state testing program, the 
state did not report test results for individual 
pupils. Any scores for individual pupils were a 
result of a district's requesting the scores from its 
scoring contractor. The state required that districts 
submit a frequency distribution of pupil scores but 
never possessed or reported the score of a particu- 
lar pupil. No pupil scores have bet or are. reported 
because the purpose of the former testing program, 
as well" as CAP, is program evaluation (at the 
school, district, and state levels), not the evalua- 
tion, placement, or diagnosis of pupils. 
' Earlier state-required tesHng had many draw* 
backs. The costs were large, and districts had tp 
bear them; the tests were too long, and some tests 
were unrelated to the school goals. When the 
testing program wa^ revised, it was decided to 
move to matrix sampling to provide tests long 
enough and broad enough to cover the wide variety 
of skills taught in California schools. Because no 
intention existed of providing individual pupil 
results, the move to matrix sampling was feasible 
and practicable, Hie factors in that decision were 
the following: 

• There was a desire to limit testing time to 
about 30 minutes. Only matrix sampling 
could cover a broad content domain in such a 
short time. 

• With the state assuming the costs, districts 
could use newly freed funds for their own 
program of further testing at the pupil level. 

• No one testing system could likely satisfy 
all districts. Some prefer standardized tests; 
some, tests that are curriculum-imbedded and 
criterion-referenced; and some, ..their own 
tests. It would be impossible to select a single 

\^atewide test to satisfy all preferences. 



5. Alhmy briglitct diildrcn gut the cas\ forms, and 
the slow er children got the hard forms. How tan 
our percent correct score mean an) thing when 
none of the kids took the w>hole test? 

We try to make all forms equally ditTicult. In 
many cases, such as the case of the grades two and 
three Readmg Test, the difficulty level of all the 
forms is close to being equal. Teachers who believe 
otherwise have often looked at just one or two 
questions on each form. Some forms have harder 
questions at the beginning and some at the end; 
but on the whole, all are about the same. Thus, 
each pupils percent correct score is a good 
estimate of what his or her score would have been 
if he or she had taken the complete test. 

6. Our second grade reading score pretty good 
except for our low> score in vocabulary. If we 
were to raise that percent correct score by 20 
points, what would our total percent correct 
score be? 

This question is frequently asked once persons 
have overcome the natural initial hesitation to 
accept the results. It is a signpost of real progress 
with teachers and shows that they are ready to 
begin a careful examination of the skill area scores 
on the second page of the report. 

To answei the question, one needs four pieces of 
information, the total number of items on the test 
(nj_), the number of items in the skill area (n<,), the 
percent correct score for the total test (pj); and the 
desired change in percent correct score for the skill 
area (Pj). The first two pieces of information are 
available from the Interpretive Supplement, the 
next can be read from the school report, and the 
last is provided by the teachers. The revised 
percent correct score for the total test (Pj-^^y) 
would then be: 



Prcv = I't + 
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For example, if a school with a grade two 
Reading Test peicent correct score of 60.0 (24th 
percentile) were to raise its vocabulary percent 
correct score by 20, the percent correct score for 
the total test would be: 



00 



= 64.8 (35th percentile) 
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Detorinitiiiig What a "Satisfactory"" 
Result Is 

Any interpretation of results revolves around 
this question: **llo\v well did we do in comparison 
to how we should have done?" Answering the 
question involves both objective comparisons and 
such subjective matters as one's own expectations 
and a district's goals. 

..A,s to objective comparibons, the first compnri- 
.son to be examined ib the comparison score band. 
5t tcllj) >ou what other schools and districts with 
.similar background factors did on the average. For 
example, a comparison band ranging from the 25 th 
to 45tli percentile tells you that schools with 
similar background factors are scoring somewhere 
around the 35th percentile. This is not an exact 
means of comparison, but it is a starting place. 

It IS also good to take into account special 
circumstances that may be present. These include 
any background factors not detected by the 
comparison band. This m formation should help 
identify what a satisjattory score is provided that 
satisfactory means *'about the average of schools 
similai to mine." Of course, some persons consider 
this dennition madequate. Some feel that the 
general average being achieved by all schools is too 
low, and others feel that the state average should 
be just a minimal goal. 

Interpreting DilTerences Between Scores 

By this point many testing coordinators are 
moving toward helping school staffs use results for 
program evaluation and improvement. This, of 
course, is one of the principal -purposes of the 
entire testing program. 

Siiok a close analysis often raises detailed ques 
tiofl?rbJ scores, among them these 

c|ntra|[ cbikepts: 

• iWjvjjiu^h of a difference from our sat fac- 
tory score*is a big difference?" 

• Is this year's vresult an exceptional result, or is 
it part of a consistent trend? 

• If this year's result appears somewhat excep- 
tional, what is the likelihood that it will recur 
if we do nothing about it? 

These questions are discussed in this part of the 
chapter. At times, questions in these areas may 
exhaust your knowledge of the testing, program. 
You may then wish to call a CAP consultant for 
help. 
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Interpreting Differences in Percentile Ranks 

A school's percentile rank in a content area is 
the percent of California schools that had a lower 
average score in (hat area. Thus, if a school has a 
percentile rank of 25 in grade six written expres- 
sion, it means that 25 percent of the schools in 
California had a lower average score on that test. It 
does not mean, however, (1 ) that the average pupil 
in that school had a test score higlier than 25 
percent of the pupils in the state, or (2) that all the 
pupiL in that school had lower scores than 75 
percent of the pupils in the state. Other incorrect 
interpretations of percentile scores are also some- 
times made. 

Although percentile ranks are used because of 
their straightforward definition, they are not as 
simple as many think. In fact, many important 
nuances are frequently ignored or misunderstood. 

Perhaps most serious is the misconception that 
percentile ranks are a linear scale. This misconcep- 
tion is exemplified by a phrase frequently printed 
in newspaper articles. *Tercentile ranks are a scale 
from 1 to 99." Although true, the statement gives 
the impression that the difference between percen- 
tile ranks of, say, 10 and 20 is the same as the 
difference between 40 and 50. In fact, the differ- 
ene between 10 and 20 is almost twice the 
difference between 40 and 50 because test scores 
tend to bunch up in the middle of the distribution. 
Since scores are much closer together in the 
middle, it is easier to pass 10 percent of the schools 
in the middle of the distribution than at the 
extremes. 

Differences between schools in the middle of the 
distribution are quitg^ubtle. For example, most 
people could not detect real differences between 
the reading levels of average pupils from schools 
scoring at the 45th and 55th percentiles. Tliis is 
not true just of state testing percentiles but of 
percentiles in general. It is equally doubtful that 
most people could detect differences in problem- 
solving ability between someone with an IQ at the 
45th percentile and another at the 55th percentile. 
There simply isn't much of a difference between 
these two points. 

But what is an important difference? When do 
we begin to notice real dissimilarity b(^een 
schools of different percentile ranks? Let's lOQk 
first at grades two and three, which are given the 
same state Reading Test, There we find that a 
second grade scoring at the 90th percentile is at 
about the grade three average, while a third grade 
scoring at the 1 0th percentile is at about the grade 
two average. Thus, in the primary grades the 10th 
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and 00th percentiles roughly equate average test 
performances a year behind and a year ahead of 
average, respectively. These two percentiles can be 
used as benchmarks. A school scoring at the 10th 
percentile should consider that its average pupil is 
significantly below the state average, and the 
inverse is true for a school scoring at the 90th 
percentile. 

This is only a starting place, of course. The 
differences are readily distinguishable between 
pupils of schools' scoring at the 10th and 90th 
percentiles. Likely, much smaller differences say, 
between the 30th and 70th percentiles would be 
noticeable too, though not as easily. 

We have been speaking just of noticeable differ- 
ences, not statistically significant ones. If a new 
reading program as tested among several thousand 
pupils, for instance, it wouldn't take a 25-percen- 
tile change to show that the program was havnig an 
effect. A change of a few percentile ponits- 
although it may have statistical significance -is 
subtle and not likely to indicate large differences. 
However, large changes of the type discussed 
earlier do translate into readily observable differ- 
ences in abilities or achievement. 

Interpreting Differences in Percent Correct Scores 

Percent correct scores have also been frequently 
misinterpreted. Districts have been known to mini- 
mize differences between schools whose average 
percent correct scores on the Survey of Basic 
Skills: Grade 12 differed by 9 percent. They 
reasoned that since one school achieved only 9 
percent* more correct answers than the other, the 
difference between them could not have been 
great. ^ 

However, differences this large in percent cor- 
rect scores are substantial. One can imagine two 
classrooms of pupils taking a typical test con- 
structed by a teacher {B students would average 85 
percent correct, and C students would average 75 



percent correct). If the first classroom had all B 
students, we would expect its average on the test 
to be 8S. If the second class had half/? students 
and half C students, the class average on the same 
test would be 80. In this case an average difference 
of just 5 percentile points would mean that half 
the students in one class were achieving at a level 
one grade lower than in the other class. 

Only further research will tell us how much 
difference it takes in test bcores before one detects 
a real difference in pupils. However, a general 
guideline might hold that a difference of one-half a 
standard deviation would be the start of noticeable 
change. In grades two and three this difference 
translates roughly into 5 percentile points, in grade 
six, 4 percentile points, and in grade twelve, 3 
percentile points. Thus, if one school has an 
average percent correct score in grade three more 
than 5 points higher than another, one would begin 
to notice real differences in pupil achievement. 
This difference translates into 25 percentile points 
in the middle of the distribution but only 10 
points or less in the extremes. 

Comparing Test Scores Longitudinally 

Two difficulties arise in examining a school's 
long-term trend in state testing. 

• The tests have been changed over a period of 
time. 

• The same statistics weren't always reported. 

This section provides guidance in making and 
using long-term comparisons. Some instances defy 
exact comparison and require professional judg- 
ment by the testing coordinator. 

First, lefs look. at the tests used during the past 
five years (Figure 1). Those that are directly 
comparable in Figure 1 are joined by arrows. 

Thus, test results for grades one, two, and thiee 
are directly comparable onl> between 1971-72 and 



Grade 



1971.72 



1972-73 



1973-74 



1974.75 



1975-76 



One 
Two 
Three 
Six 

Twelve 



Coof) > Coop 
Coop • > Coop 
Coop — Coop 
CTBS^ ^CTBS- 



ITED 



/TED- 



Entry Level Test 
Reading Test 
Reading Test 
'CTBS 

'ITED 



Rbvlsion of ELT^ 

Revision of /?r » 

Revision of RT 

Survey of Basic Skills: 

Grade 6 
Survey of Basic Skiiis; 

Grade 12 



Revision of EL T 
Revision oi RT 
Revision of RT 
Revision oi SBS: 
Grade 6 

Revision oi SBS: 
Grade 12 



Fig. 1. Tests used in California, 1971-72 through 1975-76 
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1972-73 and between 1974-75 and 1975-70. In 
gradej) bix and twelve, no results Mnce the 1973-74 
bchool >ear are directl> comparable to the previous 
year's results. 

However, that two years are not directly com- 
parable does not rule out longitudinal tracing. It 
would indeed be ill-advised to compare entirel> 
dissimilar ^ests, such as comparing grade one Coop 
results (a reading achievement test given at the end 
of the school year) with EiUry Level Test results (a 
reading readiness test given at the beginning of the 
school year). But other than that you can usefull> 
look at trends if >ou observe the following pomts. 

• Raw scores (or percent correct scores) will 
not be comparable. It is possible, thougli, to 
estimate tl\e change for tests in the CAP. The 
average score on the original version of the 
EiJtry Level Test was about 1.5 points higher 
than the revised version. The original version 
of the Reading Test was about a half-point 
harder for second graders, but about a half- 
point easier for third graders, than the revised 
versibn. Similarly, for grades six and twelve 
the tests were revised for 1975-76. 

• When tests are changed, differences in scores 
may be caused by differing te'st content, not 
by changes in program quality or student 
achievement. Differences in test content and 
the school's curricular emphases must be 
compared before a judgment is made. Even 
then, that judgment must remain tenuous. 

The second problem, that of changing statistics, 
is not nearly so difficult. Direct conversion tabLs 
allow comparison of pupil norms (the way some 
districts report school scores for standardized tests) 
and school norms (tlie way the state has reported 
school results for the past six years). The following 
discussion should help resolve these difficulties. 

Comparing Pupil Norms lo 
School or District Norms 

Occasionally, confusion exists over the way in 
which percentile scores ai^ reported for state tests. 
The confusion is over whether a score Represents 
(1) the average pupil in the school district; or (2) 
the comparative statewide ranking of the sciiool or 
school district. Many districts have reported their 
results as a percentile rank of pupil norms (average 
pupil). Thus, a score of 45 means that the median 
9r mean pupil score was 45 on the publisher's 
national pupil norms. State results, however, have 
been reported for many years as the ranking of 



districts in California (comparative statewide rank- 
ing). Tlius, a district score of 45 means that its 
median or mean in the case of matrix sampling- 
score was higher than 45 percent of the other 
districts in California. 

The two statistics are not directly comparable. 
However, both have been available to districts and 
schools for the past several years. Thus, the 
relationship between the two sets of scores can be 
seen by examining results from previous years as 
well as current ones. For example, when the 
Cooperative Primary Reading Test ( Coop) was last 
given as the grade three state-mandated reading test 
in spring, 1973, a district whose median pupil 
scored at the 59th percentile on publisher norms 
was at the 70th percentile of districts in the state. 
Thus, at that grade level at that time, the two 
numbers, 59 and 70, described exactly the same 
performance in different ways. (At the lower end 
of the distribution, the state, school, or district 
percentile rank is lower than the equivalent pupil 
percentile rank.) 

If a district has continued to administer the 
former state-mandated tests, the two sets of 
information can be equated easily. Suppose, for 
example, that wiien a district administered the 
Coop to its third graders again Ihis year, the 
median pupil scored at the 25th percentile on 
publisher's norms. However, on the state Reading 
Test, the district scored at the 12th percentile. The" 
question is: Are the two pieces of information 
consistent? 

Here we do a little backtracking. We can go back 
three years and find that the 1972-73 Coop scores 
placed the median pupil at the 27th percentile. 
That result would have placed the district at the 
10th percentile of districts in California.* Thus, we 
find that there has been essentially no change in 
test scores over the past three years (comparing the 
fon;ier 27/10 with the current 25/12), The 25th 
percentile on the publisher's pupil norms and the 
12th percentile on the California district norms are 
roughly equivalent. 

The above technique doesn't always work. 
Sometimes two tests actually seem to give different 
results. Suppose, for example, that on the fall, 
1973, Comprehensive Tests of Basic Skills (CTDS), 
a district's median pupil scored at the 37th 
percentile on the publisher's norms. That result 
would have placed the district at. the 30th percen- 



Pcrccntilc^ Rank Norms Tabks and Summary of Test Scores for 
the Caitjornta State Testnig Program: iirades One, f wo, and Three. 
Sacraincnlo- Calilurnia State Department of Lilu^atiun, 1973. 
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tile of California districts. Then in 19^5 when the 
district chose to administer the CTBS, the median 
grade six pupil "was still at the 37th percentile, but 
the district's state rank on the new Survey of Basic 
Skills fcllio the 15th percentile. - 

In this case, the reason for the change probably 
lies elsewhere, perhaps in differences between the 
tests. Tlje CTBS majj^ measure areas emphasized by 
the district more than the Survey does. However, 
since the Survey measures ,the common instruc- 
tional objectives of California schools, it would 
seem reasonable for the district to reflect on why 
its pupils do better on the CTBS than on a test 
designed specifically for California. But the drop in 
percentile ranks need not be interpreted as a 
decline in program quality. It could be caused, for 
instance, by instructional emphases different from 
those.measured by the new test. 

In summary, it should not be assumed that 
different ways of reporting test results prevent 
comparisons. Many valid judgments still can be 
drawn, even during this transition period, espe- 



cially in districts that still use the tests that used to 
be state-mandated, the Coop, CTBS, and ITED, 

Determining the Reliability of 
Reading Test Scores 

The information contained in thib section can be 
used to determine how reliable specific tost results 
are. It should be remembered that usually the 
results of more than one testing session are needed 
to det^mine how successful a program is. With the 
information provided here, one can decide how 
many sets of results are needed before firm 
conclusions,about a program can be made. 

Figure 2 shows the stability of test scores over a 
period of time. As can be seen from the two lines, 
the stability of school mean test scores is greater 
on the Reading Test than on the Cooperative 
Primary Reading Test. In other words, whatever 
one's feelings are about the stability of Coop 
scores, the Reading Test produces more consistent 
results year to year for all but the very small 
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Fig. 2. School level correlations between second and third grade test scores, by number of pupils tested in the third grade 
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schools Uhosi; with fewer than four pupils per 
grade). This finding may be important to empha- 
size to teachers, for some of them have the 
mistaken impression that Reading Test scores are 
less stable. If teachers continue to hold that 
mipression, they might be slow to initiate c^iange 
on the basis of Reading Test results. 

Given the test results of one year, some may 
inquire about the expected range of scores for the 
next year of testing. That answer can be obtained 
from Figure 3. Fifty percent of the school mean 
scores for schools of a given size change by less 
than the value of the line. Thus, among schools 

. annually testing about 40 pupils in the third grade, 
half see their mean Reading Test score change by 
3.3 percent or less. Of course this result is an 
average for all schools, regardless of how much 
they have changed between testings. A school with 
a stable program and personnel has better than a 
fifty-fifty chance that its scores will change less 
than the amount g<ven in the table. , 

Another approach to the question of stability of 

.'scores is the one taken in Figure 4. The graphics in 
Figure 4 combine both theory and actual data. 



Suppose the population statewide would remain 
constant and the same types of pupils would go to 
each school year after year. Suppose, too, that 
nothing in the schools changed; the programs, 
teachers, facilities, and administration all stayed 
the same. If this situation went on ^or a lon^ time, 
the average test score over a period o*" tiine could 
be called the true score for that sciiool, nnd each 
year's test results would Be an e<;timate of the 
school's true score. 

Of course such stability does not exist. But the 
current true score for a school can be estimated, 
given current testing data. From F|gure 4 you can 
find the probability that the average score for one 
to four year^ of results for a school is within 5* 
percent of its true score. For example, if a school 
annually tests 40 pupils at grade three,\there is a 70* 
percent chance that the average score Achieved by 
this year's class is within 5 percent of the school's 
true score. If the average for two yearslis used, the 
probability jumps to .85 that the average is within 
5 percent of the true score. Averaging results over 
three and four years raises this probability to .90 
and *92, respectively. 
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Number of Oupil« tested in third grade 

NOTE Figure 3 •« to be <ead as follows. Fifty percent of the jchooU with 40 PupiM tested at the third grade will have a mean Reading Tdtt 
score Within 3.3 percent of their mean Reading Tett »core of the previous year. 

Fig. 3. Projected.variations in third-grade Reading Test scores, by number of pupils tested 
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These probabilities are arrived at conservatively. 
One usually can be more certain of knowing the 
true score of a school than the stated values. One 
reason is that the illustration in the figure assumes 
that the reader has absolutely no knowledge about 
the achievement level of students in that school 
except for scores on the Reading Test, Knowledge 
9f Other test scores, familiarity with students or 
former students, and any other independent 



knowledge of the school raise the probability tlvt 
one can pinpoint the true score of a school. A 
second reason is more statistical in nature, that Is, 
the correlations are based on the test results from 
all schools, many of which had cnanges in their 
true scores from year to year. This additional 
source of variation, which could be minimal in a 
stable bchool in a stable community, decreases the 
probability values reported in the table. 
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Fig. 4. Probability that a mean Reading Test score for the third grade, averaged over one, two, three, or four years, will be 
within 5 percent of a school's true score, by number of pupils tested 
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Using Test Results for Program Improvement 



By now you have a firm understanding of test 
results. You have been able to examine them in 
light of their comparison score bands. You have 
been able to review previous test results, determin- 
ing whether the present results are part of a 
significant trend. The remaining steps in a program 
evaluation are: 

1. Reviewing the appropriate test with the 
teachers 

2. Identifying areas of particularly high or low 
scores 

3. Determining how well the test content is 
reflected in the curriculum 

4. Recommending changes 

These steps are explained in the following 
paragraphs. 

Reviewing the Test 

Once teachers understanu the overalhresults on 
page one of the Report on the Survey of Basic 
Skills, they should examine' the skill area results on 
page two. They should now start developing 
strategies for improving specific parts of the pro- 
gram. 

You should direct the attention of the teachers 
to the meaning of the skill area terms and the ways 
in which skills were measured on the test. The 
principal sources of information are the skills 
charts in the interpretive supplements and the Test 
Content Specifications booklets. Separate booklets 
are published for reading, mathematics, and writ- 
ten expression (including spelling). The Depart- 
ment of Education has mailed one copy of eaJi 
booklet to each district. Additional copies arc 
available from Publications Sales, California State 
Department of Education, P.O. Box 271, Sacra- 
mento, CA 9.5802, telephone (916) 445-1261 or 



(916) 445-3497. A secondary source is Student 
Achievement in California Schools, 1974-75 
Annual Report, This book provides sample test 
items for sel.ected skill areas and contains a detailed ♦ 
discussion of the analysis of statewide results.^A 
similar publication is planned for each year. Stu- 
dent Achievement may also be ordered from the 
above addtess. 



Identifying Areas of High* 
and Low Scores 

After teachers have reviewed these- documents, 
they should understand the terms for each skill 
area and the method of measuring e^ich area. Tliey 
aie now ready to interpret information on^the 
second page of the Report on the Survey of Basic 
Skills, 

The score for each skill area is.comparcd to its 
lespective contentarea score. Naturally, a skill afea 
Score can- be either significantly lower than the 
content area score, about the same, or significantly 
higher. The difference is shown by whether the 
series of dashes representing the skill area scores i.s 
completely below (to the left of) the X represent- 
ing the content area score, overlaps the X, or is 
completely above it. 

It often is useful to make three lists of skill areas 
(one list for each category of possible result) and 
to give extra attention to any area that is extremely 
different. The inrerpretation of these lists depenus 
on the overall akessment of the total content 
area. For example,Nf a content area score has been 
judged to I ' very] low, it may be necessary to 
redevelop the entire curriculum for that area. In 
this ca5e, finer aiiulyses will not be necessary or 
useful. More typically, however, the total score will 
be judged to be within reason, and a few skill areas 
will be identified as needing improvement. 
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Determining the Reflection of Test , 
Content in the Curriculum 

One reason for a careful review of the test 
content is to make sure that the material being 
tested is the same as that being taught in your 
classrooms. If it is not, low scores do not neces- 
sarily mean low achievement but only different 
areas of achievement. 

If teachers' objectives are different from those in 
the Test Content Speaficathns, the teachers need 
to determme whether they sj^iould adjust their 
objectives. Although there is no state-prescribed set 
of objectives, the Test Content Specifications were 
drawn largely from the state curriculum frame- 
works. As such, they reflect the orientation of a 
vast majority of California school districts. 

A decision to redirect learning toward the 
content listed in the Test Content Specifications 
means that a luajor curriculum development effort 
will come out of this year's test review. Reviews in 
future years can then focus on the exten^feio which 
pupils master the stated objectives. 
* If a district rejects the content listed in the Test 
Content Specifications, it must develop its own 
equivalent document and its own, instruments. 
Then, when future state test lesults show that 
pupils are not mastering thp content of those tests, 
the district can provide information to teachers, 
parents^ school board members, and the public as 
to how well its local objectives are being met. 

Recommending Changes 

By this time you may be near to conclusions 
about your instructional program, which may be 
strong or may need improvement in part or whole. 
The weak parts may come from improper emphasis 
or ineffective me.thods of presentation, If you have 



determined such causes and have developed pro- 
posed solutions, you will want to start putting the 
changes into use.' 

On the other hand you may need more informa- 
tion befOTfe you are willing to judge the achieve- 
meni levels of your pupils. A frequent reason for 
this x:onclusion is the belief by teachers that low 
scores are caused by poor test administration 
procedures. In that case action is needed to ensure 
that next year's results will be usable. This some- 
times is the only conclusion that comes out of a 
first-time Review of results, but it should be viewed 
as a real step forward. Although it may be 
discouraging to wait another year, you will know 
that a careful review of the results Avill be possible 
next year. ^ 

Your professional judgment may tell you to wait 
for another year's results befqre reaching final 
conclusions. However, you should commit your 
tentative conclusions to paper now while noting 
^ the information you will need next year to confirm 
or refute them. , 

Although you already may know how you want 
to carry out a program review, a four-page, 
three-step outline used successfully by one district 
follows this section for your use. Eacli school staff 
in the district, assisted by central office staff, used 
the form to guide its program review. CAP results 
served as a focal point for the review. A summary 
of the findings of each school staff was presented 
to the schooL board. Recommendations tended to 
fall into three categories: instructional modifica- 
tions/changes, test administration readjustments, 
and staff development . directions/ redirections. 
They were color-coded before going to the board 
(with recommendations on instructional modifica- 
tions/changes ouMined in yellow, test administra- 
tion readjustments, in blue, and staff development 
directions/redirections, in pink), making the report 
clearer to the board. 



A PLAN FOR ANALYZING CALIFORNIA ASSESSMENT PROGRAM DATA 



TOPIC ; -PROGRAM EVALUAtiON TECHNIQUES/PROGRAM IMPROVEMENT 



QQ^* To u^e all evaluation data in such a way t^<U continuous 

program improvement is promoted toward ^stabTi-^hed district 
goals 



OBJECTIVE: To use data from the California Assessment Program in such a way 

that programs designed to promote the "acquisition of basic 
academic skills" are continuously improved. 



STEP I 

REVIEW THE CONTENT OF THE TEST IN RELATION TO THE INSTRUCTIONAL PROGRAM TO DETERMINE 
THE DEGREE TO WHICH THE TEST IS TESTING WHAT IS BEING TAUGHT. 

^PART I 



a. First determine what is meant by each contept area listed below by examining 
the test content specifications in reading for grades pwo and three. 

b. Next determine the degree of emphasife given to each content area in the instruc- 
tional programs offered at your school in grades two and three. 

(Use the scale b.elow to indicate the ' degree of emphasis.) 

1 - Heavy emphasis 3 - Minor emphasis 

2 - Moderate emphasis A - No emphasis . - ' > ^ 



Word Identification 
Phonetic analysis 
Consonants 
Vowels , 

Vocabulary 
Denotational 
Relational 
Synonyms 

Comprehension 
Literal 

Details 
Interpretive 

Details 

Main Idea 

Study-Locational 



Grade 2 Grade 3 
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* STEP I (continued) 




REVIEW IN THE ANNUAL REPORT TABLES ON READING, WRITTEN EXPRESSION, AND MATHEMATICS IN 
RELATIOM TO THE INSTRUCTIONAL PROGRAMS IN GRADES SIX AND TWELVE. 


PART II 




a. First determine what is meant by each content area listed below by examining the 
tables in the annual report. 

b. Next determine the degree of emphasis given to each content area listed below- in 
the instructional programs offered in grades six and twelve. 


njse the scale below to indicate the decree of emphasis.) 


1 - Heavy emphasis 

2 - Moderate emphasis 


3 - Minor emphasis 

4 - No emphasis ^ 


^^^'-iSrade 6 


Grade 12 


Word identification' * / 


Vocabulary 


Vocabulary 


Comp r eh ens i on 


Comprehension 


Literal 

Interpretation/Critical. 


Literal 

Interpretation/Critical ' 


Studv-locational 


Sentence recognition 


Sentence recORnition 


Sentence -manipulation 


Sentence manipulation 


Capitalization 
Punctuation 
Word fcrms 
LanKuase choices 
Standard usage 
Relationships 


Capitalization and 
punctuation 

Paragraphs 

Word forms 

Laneuai^e choices 

Arithmetic 

Number concepts 


• Word forming 


Whole numbers 
Fractions 


Arithmetic 

Number concepts 


Deciirals 
Algebra 


Whole numbers 
Fractrons 


Geometry 


Decimals 
Geometry 
Measurement 


Measurement 

Probability and 
statistics 


- Probability and 
statistics 




-2- 






STEP II 



ANALYZE YOUR SCHOOL'aiEST RESULTS IN RELATION TO YOlSk SCHOOL'S INSTRUCTIONAL PROGRAM, 
BACKGROUND FACTORS, AND TEST ADMINISTRATION PROCEDURES; AND YOUR STAFF'S ATTITUDE 
TOWARD THE TEST, 

a. First identify subcon'tent areas which are low and which do not overlap with • • 
other bands. I ^ 

b. List these areas below. (See school-level* Reading Test results by cont-ac area.) 



c. Analy;:e the reasons for (causes behind) each of tho low, nonover lapping bands above. 
Circle the areas, above wjiich you and your staff feel are low because of a low 
degree of enphasis., 

d. Indlchce below what your staff feels are tho causes behind the low -skipres on the 
areas of high percentage of instructional emphasis you identified above. 



e. Analyze the accuracy and wonpleteness of the background information supple jd for 
your school. Note any inconsistencies, new awareness, and so on. I— y 



t. Evaluate test administration procedures (e.g., direction giving, time of the day, v. 
and 80 on). One might ask, for example, whether students were instructed to give 
their best answer to every single question. 



g. Assess staff attitudes and general climate in relation to the test. 
' To what extent does a degree of positive, healthy concern exist? 



To what extent are staff, members able to deal with the subject of testing analyti- 
cally and objectively? ^ 



STEP III 



IDENTIFY A PLAN. 



a. Review your responses to the questions included in steps I and II. What direction 
do you and your staff intend to take on the basis of information you have identified? 
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VI 



• Planning Your' Report to, the Bob^;d * 

• Identifying the Contents o^the Board Report 

• Examining Sample Sections from Othei;^Districts' Reports 

• Organizing the Board Meeting 
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Reporting Results to Boards of Educatidn 

X 

TJie districtwide resists of the testing program, but not the score or relative position of individual 
pupils, shall be reported to the governing board of the district at least once a year at a regularly 
scheduled meeting 

Education Code Section 12826 



"Mr. President and members of the board of 
education ..." does not have to be your last 
noncontroversial comment on the evening you 
present test results. With the righ; technique, the 
benefits of a clear, concise, complete report can 
shine through even the gloom of poor scores. All it 
takes is planning, plannmg, plannmg. Here is the 
planning procedure: 

• Planning 1: Plan what you are going to say. 
Do not just cast the test results into the 
meeting hall. You*re the expert; organize and 
interpret the test results. Make the board and 
audience see the real meaning and significance 
of the results. Make your report complete so 
as to stop misinterpretations before individ- 
uals start making them. 

• Planning 2 Compose again -a clear, concise, 
complete written board report. Much of this 
chapter provides tips on the organization and 
writing of the report. 

• Planning 3: Know in advance who is respon- 
sible for what at the board meeting. Does the 
testing coordinator handle the whole show? 
Or do the superintendent and other district 
administrators step in with their own words 
of interpretation and future plans? Plan the 
presentation in advance. 

The reception that greets you probably has as 
much to do with the quality of the report itself as 
with the scores. This point is sometimes obscured 
by the nearly unavoidable negative tenor in wliich 
many such board reports are given. Be crisp and be 
positive. 



The successful board report leaves board mem- 
bers and audiences with the feeling that they know 
the results thoroughly. They know what's wrong, 
what's right, how you feel about the test results, 
and what you're going to do about. them. 

Examining Some Interesting Questions 

However, there are always some sticklers present 
with interestmg-but difficult -questions. Be ready 
for them. Often their questions are variations on 
the following: 

"Are you satisfied with these results?" 

"Why are our pupils domg better in reading than 
in spelling?" 

"Why do the children at School A acliieve better 
than those at School B?" 

"What can we do to raise these scores?" 

"What are you planning to do now with these 
new results?" 

"School A seems to be doing better than the 
others. What's its secret and should we get the 
other schools to adopt it?" 

"Is that reading program we started last year 
working out?" 

The wise testing coordinator and superintendent 
have answers ready, often they already answered 
the questions in the text of their report. Some 
well-prepared superintendents have even been 
knowii to carry around 3-by-5 cards with salient 
testing infonnation for a few weeks after scores are 



Getting Along with the 
An Insider's Advice 



''School boards know a great deal about what's happel^ing in the areas of testing, 
evaluation and accountability," reports one member of theJCalifornia School Boards 
Association (CSBA) staff. What they most need, he thinks, i\help in getting a handle 
on the current year's results. 

But it's always a good idea to start with the basics, advJses Edmund. L. Lewis, 
CSBA's Assistant Executive Secretary for Instructional Services. "They need to 
understand what a 'normed test' means, what 'average' means, what 'criterion- 
referenced testing' means, what 'matrix sampling' means . . . what these terms mean 
to their district. \^ 

"More than half of the school districts in the state have a thousand or less average 
daily attendance, and board members need to understand the effect of a small 
sample on scores." Another obvious point: Membership on school boards changes 
frequently. Newly elected members often arrive with good intentions but with little 
understanding of testing. 

"Boards," continues Mr. Lewis, "also need a clearer understanding of the 
difference between testing and evaluation. It's important for them to know what 
specifically happens in evaluation at the teacher level, the |)rincipal level, the district 
level, and the state level . . . and what role testing plays Jn the evaluation process." 

What about the board meeting itself? "The key question that needs to be 
answered is not 'what' but 'why' a certain score is above or below the anticipated 
achievement level," advises Mr. Lewis. 

"Look at the scores for trends," he continues. "Reports on any school pattern 
mean more when there's a three- to five-year comparison. If you have a local testing 
program that tests local objectives, present those results also to show another 
measurement. Avoid stereotyping when looking at the various statistical factors. 
Tliis state is so varied, we must get away from generalizations that are damaging." 



reported. That way, whenever they are questioned 
by board membcr,^news reporter, or parent, they 
have more than enougJi facts readily available. 



Preparing the Board\Report 

A basic board report miglit be organized along 
these lines: 



• Introduction 



\ 



• Summary of Results and Interpretation 

• Detailed Results \ 

• Background Factors and Other TestingJData 

• Recommendations 



The material on the following pages presents 
each of the five recommended sections of the 



report in more detail. First, the.typical contents of 
each section are described. Then, examples drawn 
from California school district board reports are 
shown as sources for ideas and techniques. 



* Introduction 

Tlie purpose of the testing is explained in the 
introduction; and the number of children tested, 
their grade- levels, the subject areas, and the time of 
the tests are given. Tlie tests are named, and the 
report may explain v/hat each test nfieasures. The 
nature and uses of the California Assessment 
Program (CAP) are outlined. Mention may be made 
of district testing wliich is to be profiled in the 
board report. Examples of introductory material 
for the repoit to the governing board of the school 
district are presented on the pages that follow. 
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1 EXAMPLE OF 
A Concise Introductory Paragraph 



iNTROEMJCTtON 



During the 1974-75 school year, all second and third-grade pupils In the Cabrlllo 
Unified School District, 22hand 208, respectively, were tested In reading 
achievement. Pupils In grade six (253) ana grade twelve (185) were tested In the 
basic skills of reading, written expression, and mathematics. The testing pro- 
cedure for the second, third, sixth, and twelfth-grade tests was first Introduced 
during the 1973-74 school year. It Is a matrix sampling procedure. In ma+rix 
sampling every student does not take the same test form, only a portion of a very 
long test. Statistical calculations In the matrix sampling procedure enable 
preparation of a district profile just as If all students had taken all Items rn 
a long test. Matrix sampling Is an efficient testing procedure when the purpose 
of the testing Is to obtain Information about the performance of gfroups of stu- 
dents. Because of this testing procedure. It is not possible to obtain Individual 
students' scores. Even Information about classroom performance would be useless 
because of the small number of students taking the test. The state does, not 
report tiie scores of individual students or classroom performance because of the 
matrix sampling procedure. 



from Cabrillo Unified School District 



2 EXAMPLE OF 
An Introduction tc the Contents of the Report 



IXiring the 1974-75 school year, the Huntington Beach Union High School District 
initiated a comprehensive program assessment plan. This plan was designed to 
provide program assessntent information to decision-makers at all levels throughout 
the district. The^intent of a con5)rehensive program assessment plan is twofold. 
The information obtained provides an indication of the status of the schools and the 
district in term^ of student perfomance and perceptions. In addition, the informa- 
tion obtained .provides a basis for priority ^decisions regarding the inprovement of 
various' aspects of the educational program. Thus, the intent of program assessment 
is not to prove or disprove the worth of various aspects of the educational pro- 
gram but rather to ijnprove the quali^ty of the educational program. 

The program assessment report contained in this document includes data from a 
variety of sources. Any given set of data taken in isolation may be easily mis- 
interpreted; therefore, this report attempts the integration of several data sets 
in an effort to place each in perspective with the others. The data presented' in 
this report are organized under six major headings, as'^follows: 

1. General Information 



This section includes* demographic and descriptive data regard- 
ing factors that tend to influence student performance on a 
group basis. 




EXAMPLE OF 

Explanation of the Tests Used 



Statewide testing at selected grade levels has been a phenmenon in ';he California 
public schools since 1961. Over the years there have been a number of changes in 
the tests enq)loyed and the. grade levels tested. During the 1974-75 school year, 
two types of statewide testing were carried out in the Huntington Beach Union 
High Schopl District. The Survey of Basic Skills was administered to twelfth 
gv?Ae students in January of 1975 under a matrix-sanpling format. The Physical 
Performance Test for California was administered to tenth grade students during 
March, April, andTSy ot 1975. 

Survey of Basic Skills . The Survey of Basic Skills is a test developed by the State 
of California for use in the California Assessment Program. The Survey measures 
student performance in the content areas of reading, written expression, spelling, 
and mathematics. This test was administered to twelfth grade students statewide 
for the first time in January of 1975 under a matrix-sanpling format. The raatrix- 
sanpling technique differs from typical testing techniques in that each student 
completes only a small portion of the entire test rather than con^leting the entire 
test. Student scores are then aggregated at the school and district levels to pro- 
vide estimates of group performance. This type of testing does not produce 
individual student^3ata. 

In addition to test data, the State Department of Education also collects pther 
data to group similar schools and districts and predict school and district per- 
formance within a comparison band or range. These data were discussed under the 
general information section of this report. 



from Huntington Beach Union High School District 



EXAMPLE OK 

An Explanation of the Purpose of Testing 

_ 

The purpose of the California State Assessment Program is to answer the question: 
"At what level are students in a district achieving after X years of schooling?" 
The objectives of the program were arranged into content areas, and skills were 
defined for each content area. The content and skill areas that were assessed in 
the 1974-75 school year are presented in Table 1. Also displayed in the table are 
the, number of test items, the test format, the number of test forms, and the number 
of items per test form. 

The test format for all tests except the Entry Level Test was a matrix sampling 
procedure. In most testing programs each student is given the same test as every 
other student in that grade. In matrix sampling," however, every student does not 
take the same test form but only a portion o£ a very long test. For example, the 
Reading Test is divided into ten forms so each second grade pupil takes one- tenth 
(25 item.s) of the entire test. Statistical calculations in the, matrix sampling „ 
procedure enable preparation of a district profile just as if all students had 
taken all items in a long test. Matrix sampling is an efficient testing procedure 
when the purpose of the testing is to obtain information about the performance of 
groups of students. 



(Continued on page VIS) 
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Table 1 
TESTS CONTBKTS ^ FORMAT 



Grade 


Nana of Teat and 
Content Arcaa 


No. of 
Items 


Katrlx 
Sanpling 


No. of 
Foraa 


No. of 
Items/ 
Fora 


Skills Tssted 


1 


ENTRY LEVEL TEST 


3S 


No 


1 


35 


laasdiste recsll, letter recognition, suditory 
diacrittination, viaual discrimination, language 
develnpnent 


2-3 


READING TEST 


250 


Yes 


10 


25 


Word identification— phonetic analysiai vocabu- 
lary; cooprehcnaion»-literal and interpretive; 
atudy-locational 


6 


SURVEY OP BASIC 


A34 


Yes 


U 


31 






Reading 


98 






f 


Word identification; vocabulary; comprehension- 
literal. Interpretive, critical; atudy-locational 




Written Expreeaion 


112 






a 
o 


Sentences— recognition and monipulfltion, punc- 
tuation and capitalization; word forms; lan- 
guage choices 




Spelling 


56 






4 


rscku{j»i^w^u(i u& uADBpoxxcQ wolq \n S'sec 01 voroa 




Kathematica 

( 


168 






12 


Arithmetic— "number conccpta , vhol** nusibera ^ 
fractions » decinala; geoaetry; neaaurcment and 
grapha; probability and atatistics 


ii 


SURVEY OF BA^IC 
SKILLS: CRADE 12 




Yaa 


IS 


33-35 






Reading 








8 


Vocabulary; comprehension— literal, interpretive, 
critical; study-locational 




Written Expreaaion 


82 






8-10 


Sentencca— recognition and manipulation, capi- 
talization and punctuation; paragrapha, word 
pArt'a; language choicea 




Spelling 


54 






6 


Recognition in context of a misspelled word 




Matheaatica 


196 






11 


Arithmetic— number concepta, whole numbers, 
fractions, declmsls; algebra; geometry; measure- 
mant: probability and atatistics 



from San Marino Unified School District 

EXAMPLE OF 

Detailed Explanation of the Nature of the Test 



The Matrix Sampling Reading Test was administered for the second time in 1974-75 
to second and thi^ grade children in California. This test consists of a large 
number of items' which are broken down' into short tests . Each child does only a 
short portion of the total battery, so that only t^-o (2) or three (3) children 
in any given class are presented with the same items. These items are multiple 
choice, as machine-scorable questions are required. 

The test was changed slightly from the previous year; some items were made harder, 
and some were made less difficult. The changes were made as the result of a 
teacher questionnaire, which was given to each teacher who administered the test. 

The largest number of items were on READING COMPREHENSION; second in number of 
items were TORD IDENTIFICATION AND VOCABULARY; and the smallest number of items 
were STUDY- LOCATIONAL SKILLS (such things as dictionary and library usage.) * 

This test is reported to us as a profile of test results in comparison with state- 
wide norms. Individual children are not identified, so the test cannot be used 
to measure individual groirth or achievement. * ^ 



from Winters Joint Unified School District 
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6 EXAMPLE or 
Explanation of Test Contents 



READING PERFORMANCE. WRITTEN EXPRESSION AND SPELLING PERFORMANCE. AND MATHEMATICS PERFORMANCE, BY SKILL AREA. 
OF CABRILLO UNIFIED SCHOOL DISTRICT SIXTH-GRADE STUDENTS , 1974-75 



Skill area 


Description of skills essessed 


State Percentile 
Rank of Score Band 
Cabrillo Unified 
Grade 6 


Illustrative test question 


WORD IDENTIFICATION 


(Total and average for word Identi- 
fication skill areas) 


89-94 






The pupil' milst Identify the correct 
sounds of vowcla* consonantsi and 
vovelv coabinationa * 




Which word has a aound in it likt 
the sound of the letters underlined 
in through? THe sound is not slwsya 
Bade by the eane lettera. 

0 rough 
0 blew 
0 bought 
0 touch • 
0 draw 




Thft pupil must identify how prefixes 
change the cleaning of a root word. 




The ending of the word biggest 
makes the word meant 

0 leas big 
0 bigger thon 
0 as big aa 
0 not 80 big 
0 most big 




The pupil nust select the meaning of 
A word aa It Is used In a paragraph. 


69-81 1 


In this story the word principal 
meana the same aa: 


COMPREHENSION 
Literal 


(Total and average for comprehenalon 
akllt'areaa) 

Aftar reading a paasa^v, the pupil 
Buat identify elenenta In the 
material read which have been 
explicitly stated. 


69-78 1 
65-78 i 


0 law 

0 main 

0 headmaster 

0 money 

In the letter to her parents^ Carol 
aaid that the highway was i 

0 ataooth 
0 bumpy 
0 forested 
0 hilly 



NOTK: This district reported its district comparison score band in the third coUinin. 

from Cabrillo Unified School District 
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• Suniinary of Results and lnterprelalion 

The results are outlined b> subject and grade in 
the summary portion of the governing board's 
report. Attention is drawn to significant increases 
or decreases and to strong and weak areas. Results 



are analyzed in relation to comparison score bands. 
Unusual findings* are reported. Some examples are 
presented here of the vays in which certain 
districts summafrized the test results and presented 
interpretations of the results. 



1 EXAMPLE OK 
A. Brief Summary of Results for One Grade 



For the past few years, reading achievement fn Cal Ifornla^schools has been slightly 
below national norms at both the sixth and twelfth grades; however, state testing 
results statewide at the slxth^grade level show an upward trepd and are now only 
slightly below national norms. With this in mind It Is apparent that our sixth 
graders are well dbove national norms In reading. In the area of written expression,, 
statewide performance Is below national norms. Therefore, though our scores at the 
sixth grade are high compared to state norms, on a national basis they would not be 
as encouraging, 

A review of the sixth-grade mathematics scores Indicates a relatively high level of 
competency In the basic areas of arithmetic. Over the past several years mathematics 
scores have been down nationwide. It appears they have now stabilized, and Increase? 
are anticipated In the future. 



from Cabrillo Unified School District 



EXAMPLE OF 

Detailed Outline of Results, Including School Rankings,, 
and Areas Above Norms 



1, Across the district, reading and science appear to be the areas of greatest 
general strength, and language and mathematics appear to be the areas of 
greatest general weakness. 

2, Performance at the ninth grade level exceeds that of the publisher's reference 
group for each of the content areas. However, this general ninth grade strength 
begins to diminish at the tenth grade level with varying degrees of severity; 
and at the twelfth grade level, performance falls below that of the publisher's 
reference group in language, madl^fctics, reference skills, and social studies. 
Within the area of reading, conyrehension skills tend to diminish at a greater 
rate than vocabulary skills, and in mathematics, conqjutational skills diminish 
more severely than concepts and applications, 

3, The individual schools sh9w a variety of strengths and weaknesses in their 
profiles. The overall performance in tHe six skill areas can be assessed 
roughly by using 24 checkpoints. Each of the six skill areas has four check- 
points (one per grade level) for a total of 24 checkpoints. Using this 
gauge relative to the publisher's reference group, the school -by-school results 
show the follovvlng: 

(Continued on page VI- sj 
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Checkpoints Exceeding Publisher's Reference Group 



School Number 1^ 

NHS * ^8 75 

HKIS 17 71 

EHS 17 71 

FVHS - 16 67 

WHS 8 33 



4. Conoposite rankings across all four grade levels by content area show the follow- 
ing relationships among the schools: 

•Ref, 

Rank Reading Lang. Math, Skills Science See, Studies 



1 M HB M M) . M M 

2 . HB M HB E)^^® E E 

3 E E FV HB FV HB 

4 FV FV E FV ' HB FV 

5 W W W" W W W 



from Huntington Beach Union High School District 



EXAMPLE OF 

Testing Results Outlined in Relation to District's Overall Out}ook 



The 1975 CTBS results indicate that the overall student performance is consistent 
with the median scores of previous years • These scores do not reveal any problem 
areas > but it is essential to recognize that average scores overlook the extremes. 
This district has numerous bright students who are <hlgh achievers. Conversely, there 
are a number of students who are achieving below grade level, Mrs, Rieckewald, 
counselor at Huntington School, made a study of the 1975 CTBS results and noted that . 
37 (15Z) 6th grade students, 72 (24%) 7th grade students, and 72 (21%) 8th grade 
students were more than one grade level below their actual grade placement in one 
or more of tha three skill areas of reading, language, and mathematics. As the 
pressure increases to trim services for economic reasons, it is hopeful that this 
district does not lose sight of one ot ins stated goals, that is, to meet the educa- 
tional needs of each student. The ear^j l/l^intlf ication of child];en with learning 
disabilities and the provision for diagnoo^ic and piescript-.ve services are essential 
to the preservation of the high standards thut is tie characteristic of this district* 



froir San Marino Unified School Distriqt 



EXAMPLE OF 

Relationship of District Programs and Testing 



The efforts being made under Early Childhood Education (ECE) are bringing about 
strong gains in reading and math, which show up especially when one looks at scores 
of children who have been present in WiJiters Schools for an entire year and have 
been pre^ and ^ost- tested (CTBS), 

The favorable results are not as apparent when data from the State Testing Program 
are used alone. This comes about because the state program includes all students 
regardless of language background, mobility, etc. District testing is administered 
only to those students in attendance in the fall and spring and is given hi the 
pupil's dominant language. (Continued on page VI-9) 
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Reading scores are higher statewide and Winters' pupils in the lower grades (K-5) 
are reflecting that trend. There continues tp be ijnprovement needed, however, 

written language and spelling . This very likely could come about with renewed 
enphasis in these areas. 

In math, Winters' pupils (K-8) show good gains as demonstrated by the test records. 
There seems tc be increasing difficulty, however, in the area of math application 
,at grade levels six through eight. This may be, at least in part, a reflection 
of the difficulty children at those levels are having with reading . 

Pupils of all levels' made good gains in computational^^kills and math concept 
development. 



from Winters Joint Unified School District 



5 EX AMPLE OF ^ 
Summary of Most Significant Results 



6.0 District Results 

District results of California/ s 1974-75 statewide testing program dis- 
closed that: 

6.1 Scores at the entry level testing are at the state 28th percen- 
tile, -vdiich is to indicate that approximately. 3 out of 4 school 
districts show higher entry level testing than does Washington 
Unified. 

6.2 Socioeconomic indicator for the district is at the 29th percen- 
tile when conq)ared to all California school districts; or put 
another way, 71% of the school districts in the state have more 
favorable, socioeconomic factors than Washington Unified. 

6.3 The percent of bilingual pupils in the district is at the 69th 
percentile Vhen compared to all California school districts. 

6.4^ Just 35 school districts in California differ in student and dis- 
trict characteristics - socioeconomic factors, bilingual factors, 
etc. - and therefore differ in. school .performance of students, 
the same is true of individual schools in a district. Our district 
is no exception. 

6.5 District scores in^Teading in the priinary grades, 2nd and 3rd, are 
within the bands of expectancy. 

6.6 District scores in reading at the 3rd grade level have ijn)roved 
over the previous year - from the state 3Sth percentile to the 
state 41st percentile. 

6.7 District scores in reading, written expression, spelling, and 
mathematics at the 6th grade level indicate that the average scores 
iji these areas were below expectancy. These scores were within and 
above the band of expectancies the previous year. 

' 6.8 District scores in grade 12 reading, written expression, 

spelling, and mathematics are within the band of expectancies and 
the average score in mathematics was above expectancy. 

" .e reading and mathematics scores for grade 12 are significantly 
higher than those of the previous year - from the 13th to the 41st 
percentile in mathematics and from 9th to the 30th percentile in 
reading. 



from Washington Unified School District 



VI-9 



iC 



51 



• Detuiled Results 

All significant rebultb are given, both in percen- 
tiles and percent correct, in the portion of the 
board report in which detailed rebuith are pre- 
sented. Where useful, bcores arj? broken down b> 
grade levels, subjects, and^ schools. Previous years' 
results are compared wltli the current ones, with 



graphic techniques used where neces'iary to draw 
t.ends. Comparison score bands are shown. State- 
wide results are outlined. When necessary', terms 
are defined and explained. Some examples of the 
ways in which certain school districts presented 
detailed results in their reports to their governing 
boards follow. 

/ 



EXAMPLE or 



Small Graphs for Each Grade, with Expla^iatory Text and School Scores 



Cabrlllo UnlfI.ed School District third-grade students have also consistently 
scored above the state average- 

Grade Three State Percentile^ Rank 



1970-71 


1971-72 


1972-73 


1973-74 


1974-75 


71 


51 


66 


61 ' 


67 



CUSD Test Scores In Comparison to State Percentiles 
100- 



£ 50- 




25 



n I I I I 1 

70-71 71-72 72-73 73-74 7^75 
Years 

GRADE 3 READING 

In our District we also use the Cooperative Primary Test ^s a separate nation- 
al ly-normed testing program for grade three, so we have aval lable Individual 
student and classroom performance in addition to schooLand district per- 
formance. The results of the .Cooperative Primary testing program were reported 
to the Board a1 an earlier date" and are included In the appendix of this report. 
In addition to district Information on grades two and three, we aljso receive 
yearly school reporls. Unfortunately, we are unable to provide historical In- 
formation for the schools beyond the 1973-74 school year because the state 
switched test Instruments and reporting format. 



Grades Two and Three — State Perner.MIe Rank 







Alvin S 


. Hatch 


El Granada 


Faral lone View 


Klng^s 


Mountain 




Grade 




74-75 


73-74 74-75 


73-74 74-75 


73-74 


74-75 




2 


78 


68 


51 51 


62 61 


42 






3 


83 


44 


43 94 


3§ * 59 


85 


76 
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2 EXAMPLE OF 
. Scores for Each Subject and Corresponding Comparison Score Band 



SURVEY COMPARISONS 



Content 
Areas 


State Percen- 
tile Rank of 












Actual 
Score 


Comparison 
Score 
Band 


Inde> 


Positions of Actua 
Band (000) on the 
1 ^ 2 


1 Score 
State Pe 
5 5 


(X) and Com 
rcentile Ra 
0 7 


parison Score 
nk Scale 

5 ^ 99 


Reading 


11 


11-44 




fioooooo 


300000 






Written 
Expression 


30 ^ 


' 13-39 


' W 


000000 


DBOOO 






Spelling 


26 


11-47 


w 


OOOOOOB 


3000000 






Mathematics 


22 


9-39 


w 


OOOOOOBO 


30000 







This section provides comparative data based on the test scores and the background 
factors for Winters. Reported are the percentile rank of the actual "Percent Correct" 
score, the percentile rank of the comparison score band, the "Interpretation Index," 
and a graphic representation of the percentile scores. 



State PercentiJ.e 
Rank of the Actual 
Score: 



State Percentile 
Rank of the 
Comparison Score 
Band: 



Interpretation 
Index: 



This indicates how Winters High School 's actual "Percent 
Correct" score ranks among all other schools in California, 
The school which is at the median has a percentile rank of 50. 
As an example, our school district ranks above 11 percent 
of the districts in the state in the content area of reading. 

The Comparison score band indicates the middle 50 percent of 
the entire range of percentile ranks which have been obtained 
by schools with characteristics similar to Winters. The computa- 
tion of the comparison score band involved consideration of the 
background characteristics of the students and the special 
circumstances of the school. The comparison score band enables 
us to compare the scores of Winters with those of schools that 
have similar background characteristics. (See next section for 
discussion of backgrourd factors. The comparison score band, 
indicating typical peiformance of districts like Winters, ranges 
from the 11th to the 44th percentile. 

This is an indication of the position of Winters' percentile 
rank in relation to the comparison score band. On the average, 
25 percent of state schools will fall above (A), 50 percent fall 
within (W) , and 25 percent below (B) the comparison score band. 
Winters' scores all fall within (W) the band. 
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3 EXAMPLE OF 
Brief Text Explaining Results 



\ 



READING TEST> MY, 1975 
~ GRADES i-5 ' 

CALIFORNIA ASSESS^E^f^ PROGRAM 



In May, 1974, Winters second grade pupils answere d 59.5 percent of questions corre<;tly 
on the Reading Test. In 1975, the second grade pupils answered 62*0 percent of the 
questions correctly. ^ ^ 

In 1974, Winters secoi,id gr? students scored at the 21st percentile rank, as com- 
pared with scores statewide and in 1975, at the 27t}i percentile rank, as conq)ared 
'with second graders statewide. 

in 1974, Winters third grade students answered 75.4 percent of the questions correctly 
on the Reading Test, and in 1975 the MEAN SCORE was 76.5 percent correct. Because of 
tlie increase in reading scores at the third grade level .statewide, the Winters' per- 
centile rank shifted from the 24th percentile to the 21st percentile, wher con?)ared 
with third grade pupils statewide. ^ 

Both of these scores are well within the expectancy b|nds for districts like Winters. 
It should be noted that the drop at the third grade level ffoni tfie.,24$h to the 21st 
percentile does not signify an actual drop in reading test scores. Winters' pupils 
actually made a gain of from 75.4 percent coirect to 76.5 percent correct on the test. 

Administrators throughout the state are very pleased that third grade reading scores 
in California are now above the NATIONAL NORMS for the first time in many years. 
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4 EXAMPLE OF 
Typewritten Page of Results and Previous Scores 



Achievenvcnt Factors 
Grade Subject 



State Percentile Rank 
197.2-3 1973-4 1974-5 



Perfoimance Index* 
1972-3 1973-4 1974-5 



2 


Reading 


33 


28 


26 


W 


W 


w 


3 


Reading 


45 


35 


41 


A 


A 


• • 

n 


6 


Reading 


46 


28 


19 


A 


W 


B 


6 


Writterf- Expression 


35 


22 


17 


W 


W 


B 


6 


Spelling 


.38 


22 


19 


W 


W 


B 


6 


Mathematici 


49 


37 


20 


A 


A 


B 


12 


'Reading 


10 


9 


30 


B 


B 


W 


12 


Written Expression 


32 


21 


19 


W 


W 


W 


12 


Spelling 


48 


31 


29 


A 


w 


W 


12 


Mathematics 


66 


13 


41 


A 


w 


'A 



(Continued on page VI- 13) 
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Background Factors 



Entty Level Tests 
Percent Minority Pupils 
Average Class Size" CK-8) 
Average Class Size (9-12) 
Socio -Econ Index CEntry) 
Socio-Econ Index (Gr. 3)- 
Socio-Econ Index (Gr. 6)^ 
Exp- Instruct (Per ADA) 
Parent' Educ Index (Gr. 3) 
Parent Educ Index (Gr. 6) 



* 3 - Below Expectancy 
W - Within Bq}ectancy 
A— ^ Above Expectancy 



District Value 
1972-3 1973-4 1974-^5 



State Percentile Rank 
1972-3 1973-4- 1974-5 





28.4 


26.6 . 




33 


28 




■27.3 •■ 


■ 27^ 




70 


70 


26.4 


27. S 


27.6 


50 > 


64 


67 


24.1 


23.2 


25.2 


36 


29 


45. 




i:80 


1.87 «i 




25 




— * 




1.01 






39 






1.12 






33 


$689. 




' $790 \ 


62 - 




60 






1.71 


~ / 




25 






- -1-.-68- 






10 










y 
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EXAMPLE OF 

Local Chart Giving Important Details of State Printout 



CALIFO[IMIA ASStSSHEHT.PnOCnAM 
SUIIVCY OF QASIC SKIILS - GRADE 12 - JAIIUAKY 1975 

AOTAL DISTRICT 



AREA 



READ I KG 



>/ftlTTEH 
EXPRESSIOII 



SPELLING 



HATIICHATICS 



PERCEHT 
CORRECT 



73.9 



56.4 



62.2 



6a.^ 



STATE 
ilLE imflK 



76 



73 



74 



76 



STATE XILE 
RANK OF 

cmPAiusori 

SCORE OAtID 



55 - 75 



77 



51 - 75 



50 - 79 



COMPARISON 5C0RE UANCj AND • 
LOCATION OF ACTUAL SCORE ( 7 ) 

STATE i\U RANK SCALE 
5_JO_20_30 4O_50 60:70 DO 90 95 



IMTCRPRETATION 
INUEX 
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•"EXAMPLE OF 

District Use of Pre- and Post-test Scores to Show Gains 
in Grade Equivalent Scores 



aM>REHENSIVE TEST OF BASIC SKILLS 

1974-75 

READING TEST 

GRADE I 
(7 months instruction) 



PRE-TEST- OCTOBER, 1974 POST-TEST - MAY, 1975 



AVERAGE 
mum GAIN 



N = 45 

MEAN GRADE EQUIYALENP = 0.52 MEAN GRADE EQUIVALENT = 1.90 



13.8 htonths Gain 



GRADE II 
(7 months instruction) 



PRE-TEST - (XTOBER, 1974 POST-TEST - MAY, 1975 



AVERAGE 
MONTHS GAIN 



N = 36 ' 

MEAN GRADE EQUIVALENT = 1.96 MEAN GRADE EQUIVALENT = 3.57 



14.0 Months Gain 



GRADE III 
(7 months instruction) 



PRE-TEST - OCTOBER, 1974 POST-TEST - MAY, 1975 



AVERAGE 
MONTHS GAIN 



N = 53 

MEAN GRADE EQUIVALENT = ?..70 . MEAN GRADE EC^JIVALENT = 3.53 



8.4 Months Gain 
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EXAMPLEOI' 

Chart Used to Report Data f^r All Schools.in-Gounty 




Alpine Union 
Sonsall Union 
Sorrcgo Springs Unified 
Cajon Volley Union 
Coidiff 

Carlsbad Unified 



640 

225 
11.610 

737 
3.598 
18. 



24.8 
31.0 
22.3 
23.3 
27.5 
.21.3 



1.9 
2.2 
1;8 
1.8 
2.0 
1.7 
1.8 




55 
85 
37 
45 
74 
29 
33 
87 



27.5 
29.8 
23.3 
28.2 
33.5 
26.5 
26.3 
3 





\ 

V 




2.9 


47 


\34.0 


3.1 


67 


40^3 


2.4 


18 


42.5 


2.9 


53 


38.4 


3;-5' 


89 ' 


40.5 


2.8 


39 


38.5 


2.7 


37 


37.0 






40.5 




'5.4 


35 


42,5 


4.2 




6.4 


78 


63.0 


6.4 




7.2 


95 


58.5 


5.8 




6.3 


71 


58.3 


5.7 




6.4 


78 


62.8 


6.4 1 




6.1 


65 


59.0 




5.6 


43 


55.5/ 






97 

J 







NOTE: Besides scores, the chart also is used to report the background factors shown on state \ 

printout. \ ' 
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EXAMPLE OF 

Large District Report Showing Scores for Each School 



National Norm Percentiles 









Grade 3 


Grade 6 


Grade 6 


School Name 




Level 


Reading 


Read 1 ng 


Arithmetic 


Albion (H) 




Q3 


37 


48 


68 


Transiency: 


51% 


Md 


17 


36 


49 


Minority: 


99% 


Ql 


7 


17 


28 






N 


62 


89 


37 


Aldama CH) 




Q3 


54 


52 


50 


Transiency: 


■60% 


Md 


29 


45 


32 


Minority: 


16% 


Ql 


12 


23 


14 






N 


79 


62 


65 


Alexandria CF) 




Q3 


81 


64 


66 


Transiency: 


10% 


Md 


61 


41 


45 


Minority: 




Ql 


43 


27 


22 






N 


91 


75 


92 
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EXAMPLE OF 

Chart Showing Percent of Pupils That Scored at or Above Norm 



PEKCLNT OF PUPILS WHO ATTAINED OR LXCEEDtD GRADE NORM 



Arc«i 



Grade 3 
Rending 



Grade 6 
Rcodinn 



Grade" 6 
Ari thmotic 



Grade 8 
Rend i nn 



Grade 3 
Ari thmotic 



District 
k 
B 
C 
D 

F 



kk 
27 
27 
59 
•35 
^2 



^5 

25 
25 
62 
35 
39 



^5 

26 
21 

60 
35 
36 



A3 
21 
19 

32 
25 



'»7 
50 
29 

22 
56 
37' 
3? 
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• Background Factors and Olher Testing Dala 

District background factors are often explained 
in the fourth part of the repoit to the board. 
Changes from previous years are noted. Results of 
other district testing are reported, and comparisons 
are made with results from state testing. Qther 



statistics that may bear on pupil achievement are 
reported, including survey data. Attention is drawn 
to factors not othervNise noted that may affect test 
results. Examples of background factors and other 
testing data for the report to the governing board 
are presented bciow and on the pages that follow. 



1 EXAMPLE OF' . 
Background Factors Reported and Explained 



BACKGROUND FACTORS SUMMARY- 



Background Factors 


Value for 

Median 
District 
in f^tate 


Dis trict 
Value 


State 
Percent 
Value 


' Posi 
Fact 

1 2 


tion 0 
or on 
tile" 
5 5 


f Eact 
the St 
Rank C 
0 / 


1 Background 
:ate Percen- 
loals 

'5 99 


Grade 6 Ach. Index 


67.7 


64.3 


27 




X 






Socioeconomic Index 


1.30 


0.90 


11 


X 








Parent Education Index 


2,. 00 


1.70 


12 


X 









The background factor summary is based in part on the data from the School Informa- 
tion Form that accompanied the Survey of Basic Skills: Grade 12. Each schpoi 
principal was asked to estimate and record in the School Information Form the per- 
centages of students classified in various categories. These data have been 
aggregated for all California schools, and the data are presented for the median 
school (the median school for each factor) and for Winters High School.. (The back- 
ground factor data were also us'^d to compute the comparison score band shown in the 
previous section of this report. Some background factors, such as mobility and 
percent -Spanish surname, are not included in this report because they did not sig- 
nificantly affect, the accuracy of the comparison score band.) The percentile rank 
of Winters High School in comparison with all other California schools is shown 
in the column "State Percentile Rank." The following are explanations .of the back- 
ground factors that were assessed: 

Grade Six Achievement Index: This index is a composite of the grade six scores on 
two subtests of the Comprehensive Tests of Basic Skills achieved in October, 
1973, by the pupils that feed into the high school. The subtest scores that 
were combined were from the reading and mathematics subtests. As indicated, the 
index value is less than the state median reflecting that the students enter- 
ing Winters High School have a lower achievement level. 

Socioeconomic Index: Principals estimated on the School Information Form that the 
percentages of students whose parents were engaged in each of the following 
occupational categories: (1) unskilled employees (and welfare); (2) skilled 
and semiskilled employees; (3) semiprof essionals , clerical and sales workers, 
and technicians; and (4) executives, professionals, and managers. — . 

To convert the percentage figures into index form, the occupational categories 
were assigned values from 0 (unskilled) through 3 (executives). The Winters 
High School value would indicate that the students come from an area which has 
a relatively large proportion of skilled through unskilled employees. 

(Continued on page VI 18) 
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Parent Education Index: Principals estimated on the School Information Form the 
percentages of students whose parents had attained each of the following 
educational levels: 

f Kot a high* school graduate 

High school graduate 
College graduate/advanced degree 

To convert the percentage figures into index form> the educational levels 
were assigned values from 1 (not a high school graduate) through 3 (college 
graduate). The Winters High School value, less than the state median, 
would indicate that the students do not come from an area with a relatively 
large proportion of high school/college graduates. 

As examples of the above, the Winters' grade six achievement index is higher than that 
of 27 percent of all other districts in California; the socioeconomic index is higher 
than that of 11 percent of all other districts in California; and the parent education 
index is higher than that of 12 percent of all other districts in California. 
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EXAMPLE OF 

Discussion of Background Factors 



Factors Used by the State Department of Education . In connection with the 
California Assessment Program (.state-mandated testing), the State Department 
of Education included three factors in computing comparison score bands for 
reporting state test results. These three factors were as follows: grade 
six achievement, socioeconomic status, and parent education level. The 
sixth grade achievement index was based upon the 1973 state test data for 
feeder schools, and the socioeconomic and parent education indices were 
based upon principals* estimates* Suirmary data regarding these three demo- 
graphic factors are presented in Table G-1 . The following observations may 
be made from these data: 



1. ' Grade six achievement data (for feeder schools) show that HBHS 

and EHS are somewhat above the other schools in terms of this 
student background factor. WHS shows the lowest feeder school 
sixth grade achievement index. 

2. Principals' estimate.^ of socioeconomic status show EHS with the 
highest socioeconomic level followed by MHS. WHS shows the 
lowest estimate of socioeconomic level in the ^listrict. 

3. Principals* estimates of the levels of parent education are 
similar across all schools with FVHS showing the highest level 
and EHS and KBHS showing the lowest levels. 

Aid to Families with Dependent Children , Another factor frequently used to 
estimate the socioeconomic status of a school population is the percentage 
of students in families receiving financial assistance under the program of 
aid to families with dependent children (AFDC). Summary data regarding this 
-factor are, summarized below: 
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ArDC Coun t 

Percent of 



School 


Number of Students 


School Population 


EHS 


73 


2.0 


FVHS 


55 


1.3 


HBHS 


134 


4.4 


MHS 


54 


1.5 


WHS 


197 


5.6 


DISTRICT 


513 


2.9 



These data show that WHS and HBHS have the highest percentages of their popu- 
lations receiving assistance under AFDC. MHS and FVHS show the lowest 
percentages. > 

Ethnic Distributions . Data regarding minority group distributiorjs are fre- 
quently useful in describing school populations, as this factor may point to 
language barriers that affect student performance* Table G-2 presents data 
regarding the concentrations of minority groups in the district* These data 
indicate "the following: 

1. Spanish-surnamed Americans represent the largest single minority group 
in the district followed by Asian Americans and American Indians* 

2. The greatest concentration of minority students is at WHS where 
18.8 percent of the student population is composed of minority 
group students. 

Attendance Data. One final set of data included in this general information 
section relates to student attendance patterns. Attendance data were col- 
lected during the 1974^75 school year for random samples of approximately 100 
students per grade level per school. These data are presented in summary 
form in Tables G-3 and G-4. The following observations may be made from 
these data: 

1. Across the district, ninth grade students show the highest rate 
of attendance followed by tenth and twelfth grade students* The 
lowest attendance rate was shown by eleventh grade students 
(Table G-3). The median number of days absent increased by nearly 
one day from the ninth to the tenth grade, by more than two days 
from the tenth to the eleventh grade, and dropped by almost one-half 
day from the eleventh to the twelfth grade. 

2* Table G-3 shows a variety of patterns among the schools in terms of 
the median number of days absent by grade level* Overall, WHS 
tends to show the highest rates of attendance, and FVHS shows the 
lowest rates of attendance. 

3. Table G-4 indicates that attendance is generally highest during 
the first quarter, decreases during the second quarter, remains 
about the same during the third quarter, and reaches its low point 
during. the fourth quarter* Individual schools show variations 

in this pattern, v/ith EHS showing a dramatic increase in the rate 
of attendance during the fourth quarter. This increase appears to 
be the result of a concerted effort on the part of the staff to 
improve attendance. 

Summary . The data presented in this section show that there are differences 
in the student populations among the five comprehensive high schools. These 
differences are subtle in some cases and dramatic in others, and while the 
true effect of these factors on student performance is not totally clear, 
all of these factors taken together would suggest that WHS would show the 
lowest levels of student performance generally.''' The differences among 
the remaining four schools across all factors are not definitive enough to 
make further predictions* 
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EXAMPLE oV 

Report on Results of Student Survey, with Chart 



^Vi-.20 



student Survey 

The maty^ix-sampling testing completed on a districtwide basis in May of 1975 
included a student survey which dealt v/ith student perceptions of their 
.school programs and various aspects of school in general . These data are 
presented N'n summary form by grade level by school and for the district in 
Tables SS-l\ SS-2, SS-3, SS-4, SS-5, and SS-6 contained in the appendix to 
this report. Th.e following observations my be made from these data: 

1. A majqrity of the students view their programs as preparation for 
college or both college preparation and vocational. 

2. Approxin\ate"!y one-f4fth of the students anticipate early graduation. 

3. A majority of the students plan some form of higher education 
immediately following high school graduation, and a large majority 
plan advanced education during their lifetimes* 

4. ApproximatelV^ three-fifths of the students indicated plans to enter 
professional -mianagerial or technical vocations. 

5. The number, var^iety, and quality of courses available received gen- 
erally favorable ratings from the students. 

\ 

6. The variety of ieiarning activities and quality of teaching were 
given good to exce^^^lent ratings by a majority of the students. 

7. Approximately one-half of the students rated the availability and 
quality of counseling and guidance services as good to excellent, 
and approximately 30 percent rated these services as fair to poor. 

8. Extra-curricular activities received generally favorable ratings, 
with the athletic program receiving the highest ratings and student., 
government receiving the lowest ratings. 

9. Approximately 40 percent of the students rated the number and type 
of student rules and regulations as good to excellent, and approxi- 
mately 25 percent rated them as fair to poor. 

10. The quality of facilties was f^ted good to excellent by approxi- 
mately one-half of the students,. 

11. More than 40 percent of the students rated scheduling and registra- 
tion procedures as fair to poor. ^ 

12. Slightly fewer than one-half of the, students rated daily schedules 
^s good to excellent. 

* 13. Grading policies were rated good to e)<:cellent by more than 40 

percent o? the students and fair to poor by approximately 25 percent 
of the students. ^ 

14. Interpersonal relationships (student-staff and student-student) 
were rated good to excellent by approximately one-half of the stu- 
dents, with student-administration relaticJnships 'receiving the 
lowest ratings. ^ \ 

15. Slightly fev/er than one-half of the students >rated their elementary 
school preparation for higii school as good to\ excel lent, and more 
than one-half of the students rated their hign^ school experience in 
general as good to excellent. 

(Continued on page Vf-21) 
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from Huntington Beach Union High School District 



EXAMPLE OF 

School-by-School Distribution of Letter Grades 



1974-75 REPORT CARD GRADE DISTRIBUTIONS 
BY SCHOOL AND QUARTER 

A BCD 



SCHOOL/ QUARTER 


Mo. 


%' 


No. 


% 


No. 


% 


No. 




% 


No. 


% 


GRA 


Huntingdon Beach 


























1 


/^63 


30.1 


5219 


31.6 


4207 


25.5 


1586 


9 


.6 


531 


3.2 


2.76 


2 


5035 


31.8 


4380 


27.7 


3880 


24.5 


1729 


12 


.9 


790 


5.0 


2.67 


3 


4677 


31.9 


4092 


27.9 


3634 


24.8 


1480 


10 


.1 


775 


5.3 


2.71 


4 


4955 


34.2 


3935 


27.2 


3342 


23.1 


1509 


10 


.4 


734 


5.1 


2.75 


Tot^l 


19630 


31.9 


17626^ 


28.7 


15063 


24.5 


6304 


10 


.3 


2830 


4.6 


2.73 



Westminster 
1 




5240 28.7 5239 28.7 4484 24.6 1897 10.4 1398 7.7 2.60 
^^^v^27.1 4308 23.8 1798 9.9 1580 8.7/X61 
4328 ^-^.7 1392 





NOTE: The data on the letter grades given iti ach school, by quarter, were given in the 
Huntington Beach report so that its governing board could compare this information with the 
state test results for tlie district. 

from Huntington Beach Union High School District 
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5 EXAMPLE OF 
Explanation ot Limitations of Test Results 



Evaluation of a school district's educational program implies more than mea- 
sureojnt. Evaluation implies looking at measurement in the light of objec- 
tives and . goals and making decisions about the value of the outcomes ob- 
tained. The goals of educatiop are complex , and standardized tests are 
available to measure only a few of thcvje goals. Standardized test scores 
should not be the only criteria used to evaluate a total educational pro- 
gram; but to the extent that the tests measure objectives of the program, 
the test scores represent valid measures for those objectives and are mean- 
ingful indicators of achievement. 

The chief limitation of most testing programs is that they present and 
analyze average student achievement in a limited number of cognitive con- 
tent areas. For example, the tests both in the state assessment program 
and the district testing progr<im measure achievement only in the areas of 
reading, written expression, spelling, and mathematics. Many other subject 
areas such as history, geography, science, and social science are not in- 
cluded. Neither are such areas as art, music, career education, or any 
noncognitivc characteristics e.g., self-esteem, citizenship, or cultural 
appreciation). Therefore, the reader must realize that only some of the 
information that is required for the evaluation process is provided in 
this report. Perhaps of greatest value are the teacher-rmade teste which 
are criterion-referenced and have the added strength of assessing realis- 
tically the individual needs cf students. 



from San Marino Unified School District 
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• Reconiniendations 

In the recommendations section of ilie testing 
report, certain conclusions are presented to the 
members of the school district governing board. In 
addition, recommendations are made for program 



emphasis and for further testing or analyses. The 
following example from the Huntington Beach 
Union High School District report illustrates how 
one California school district presented its recom- 
mendations. 



EXAMPLE 



Discussion and Conclusions • >^ 

As was stated earlier, this report represents an^initial effort to integrate 
various data sets into a compreiiensive program assessment, and as such it 
should oe viewed in a baseline sense rathor than as the answer to all 
questions. As readers from various audiences study and use this report, 
additional data sets may be identified for consideration in future reports. 

In reviewirijg the data presented in .this report in their totality, 'it would 
seem that the overall district performance in reading, language, and 
^.athematics is highly satisfactory relative to the remainder of the state. 
Reading is the area of greatest strength as shown by both the statewide and 
districtwide testing programs, ^he districtwide test data indicate that 
performance in the areas of language and mathematics tends to weaken at the 
upper grade 'levels in^^a relative sense. Performance in the area of science 
appears to be satisfactory as is the case with social studies. Social 
studies performance does, however, weaken at the 12th grade level. Per- 
formance in reference skills is similar to that in language and mathematics, 
weakening at the upper grade levels. 

In a relative sense ninth grade- performance in the basic skills is the 
strongest, and there is a general patccrn of weakening as students pro- 
gress through their high school programs. This pattern would suggest that 
while *here is continual growth in each of the basic skill areas assessed, 
the growth is not commensurate with the potential. The pattern would 
suggest diminishing emphasis on basic skills in the upper grade levels. 
However, it should be noted that the source of this apparent diminishing 
emphasis is not known. It could be an artifact of the curriculum, 
student selection of courses, graduation requirements, instruction, a 
combination of these factors, and/or still other factors. 

The data contained in this report would suggest that the district has a 
relatively strong academic orientation. This is supported by the contrast 
of physical performance test results as opposed to the academic testing 
and student perceptions from the TRACE data and student survey data. There 
are also indications that th.is academic orientation is commensurate with 
general student desires. However, there would appear to be a substantial 
nuiiiber of students who are not finding their needs met satisfactorily. 
This possible discrepancy could be the result of several factors similar 
to those noted in the above paragraph. Another factor worthy of further 
exploration in this regard is that of the guidance services available 
CO students. 

Student perceptions identified some areas of. dissatisfaction relative to 
the school operation and prqgram. Areas such as grading policies, daily 
schedules, scheduling and registration procedures, and rules and regula- 
tions were not highly rated by students. Guidance services came under 



(Continued on page Vl-24) 
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critjcism from students in a variety of areas. Some of these matters may 
be artifacts of the large schools and overcrowded conditions, but none- 
theless cannot be overlooked. 

Substantial data were presented regarding the individual schools, and 
these data show that no one school reigns supreme in all areas. HBHS and 
MHS tend to show the highest levels of academic performance, with EHS shar- 
ing this position in several areas, WHS tends to be consistently at the 
bottom of the school -by-school rankings , which might be expected in terms of 
the difference in demographic factors. However, in a relative sense HHS 
^ appears to have a. highly satisfactory program. ^ 

Considering the fact that some of the data and the integrated approach used 
in this report are on a first-time basis, it would be this evaluator's • 
opinion that across the district the educational program is generally satis- 
factory, with no glaring discrepancies. There are matters for concern in 
the basic skill profi'es which, if verified by a second year of data, could 
be matters of more serious concern. There are also matters for concern re- 
garding some services; namely, guidance services. Specific concerns become 
apparent for the individual schools, and they vary from school to schoolv*- 

Recomnendations 

Based upon the data provided in this report and the evaluator*s observations 
in conducting this program assessment, the following recommendations are 
offered': 

1. This report is a first, time effort at comprehensive data integration 
and, as such, should be used for baseline and status purposes in re- 
viewing and examining the program. This report should not be; used 
as a basis for overreaction at any ^level. 

2. The pattern of apparent weakened performance at the upper grade levels 
(relative to the ninth grade) should be reviewed for possible explana- 
tions. The performance in language and mathematics skill areas should 
receive particular attention; 

3. The guidance program should be reviewed in an effort to improve its 
effectiveness and/or the perceptions of its effectiveness. 

4. The matter' of general program orientation versus student needs and 
desires should'receive further attention to clarify the existence of 
a possible discrepancy. This issue has several ramifications to be 
considered*- 

5. Each school should carefully review the data specific to that school 
and attempt to determine the reasons for any apparent 4iscrepancie^s. 

6. The concept of comprehensive program assessment should be continued 
with the addition of any data set' deemed necessary and a tightening 
of procedures in data , collection and testing. The assessment program 
can be no better than the quality of the data obtained. 

7. Specific efforts should bfi made to orient staff to the concept of 
comprehensive program assessment and to engender positive attitudes 
toward program assessment. 



Organizing the Board Meeting 

, ^ Now, that we have examined the writing of the 
board report, let's look at the ways in which the 
board meeting itself miglit- be organized. There 

' appear to be four mam ways in which this may be 

,done. 

Single Meeting 

Time is set aside at a single meeting of the board 
for the entire presentation of results. This method 
assumes that all the relevant and necessary infor- 
mation can be presented at a single meeting and 
that questions and observations by board members 
can be accommodated at a single meeting. Most 
Galifomia school districts use only one board 
meeting for reporting results. 

FoUow-up Study Session 

This follow-up study session works best when 
there is higli^terest in going through results in 
considerable detail. Two board meetings are used. 
The first is a regular meeting at which the testing 
coordinator gives the usual full report. Then a 
second meeting of the board is arranged; this is a 
public study session with only the test results on 
the agenda. At that second meeting, a more 
informal tenor is adopted so that district staff 
members and board members may exchange infor- 
niatipn and opinions 'about the results. At the 
study session, ^sults are examined by j:,rade level, 
content area, s^ill area or school, or in any other 
way appropriate for the'district. 

Four Sessions 

^;arl P. Owens, Consultant in the Office of the 
Los Angeles , County Superintendent of Schools, 
recommends, thinking about four carefully planned 
meetings. "Board members need to know more 



about state assessment than can be covered ade- 
quately in one board meeting," he suggests. Each 
of the four two-hour work sessions covers a 
different aspect of the test results. One plan works' 
this way; session 1, overview and school-by-school 
results; session 2, reading results in depth, includ- 
ing skill area results and review of local school 
reading programs; session 3, math and language 
results in depth, including skill areas;"and session 4, 
recommendations for improvements in all areas, 
including cost estimates. 

Time for Staff Action 

Results are reported i.i the usual way at a single 
regular board meeting. Then another board meet- 
ing to consider action is set for one to one and 
one-half months in the future. During that time, 
school staffs carefully review the results and, with ^ 
central district staff, decide on their preferred^ 
action. They could ask for different teaching 
techniques, more training, new materials, or just 
further pupil testing. At the second board meeting, 
the board hears what action the district staff as a 
whole recommends. 

Regardless of the way board meetings are 
organized, two other ideas will improve your 
reporting of results. The first is to schedule a 
midyear review session sometime in the earl^ 
spring. At this meeting, board members are 
informed of actions jtaken since the fall testing 
report and of any further testing done since then. 

And second, in most districts a written work 
plan can be the most valuable document to come 
out of reporting results. The plan, in simple or 
detailed fashion, outlines what the district expects 
to accomplish in the next year toward nnproving 
pupil achievement and just how it pians to go 
about doing it. 
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The Complete Board Report: 
A ChecklijBt 

Here is a checklist you can use in compo:>ing your board report on testing results. 
The list is in tended to be complete, so some items below may not be necessary in 
your district. 



Introduction 

^1. Number oi pupils tested, by grade level; dates of testing; pupils exempted 

from testing 

2. Names of the tests used; the skills they measure 

3. Purpose of the testing program 

Summary of Results and Interpretation 

4. Overall summary, by grade level and subject 

5. The meaning of results, "including a comparison with previous years' 

results and with comparison score bands 
6. Apparent trends, weak areas, and strong areas 

7. Hi^lights of the results, unusual or distinctive findings which need to be 

singled out 

Detailed Results 



8. 



, 9. 
,10. 



.12. 
.13. 



Results by state percentile and percent correct for district, grade level, 
and, where desired, school (including necessary explanatior; and defini- 
tions) 

Comparison scores for previous years 

Comparison score bands (including necessary explanation and definitions) 
Appropriate graphic treatment of scores and comparison bands (perhaps 
including locally created graphs and charts or copies of the s^ate printout 
of results) 

Explanation of matrix testing and reason scores are not reported fc, 
individual pupils 

iVstatewide results 



Background Facrors and Other TestingJData 

14. Explanation and listing of background factors used in comparison score 

bands; district ranking in these; changes from previous years ^ 

1 5. Other district testing and comparison with California Assessment Program 

results 

16. Other district statistics that have bearing on test results (such as pupil 

absence rate, student survey findings, and so forth) , 

17. Comments on the validity of e results, including factors not previously 

reported which may have effeci on scores 

Recommendations 

18. Recommended steps for program changes more testing, further study, or 

other use of results 



ERIC 



other checkpoints for your board report: 



Yes No 



Are charts and graphs used generously to make understanding r.and 
comparisons easy? □ □ 

Is all of the report fully understandable to the average parent?* □ 

Could the report stand by itself as a document foi use in the 
community (without your oral explanation)? □ □ 

Are all measurement terms used in the report explained clearly and 

simply? □ □ 

Will good audiovisual techniques be used at the board meeting to make 

the testing results available and understandable to all? □ □ 

Are the negative results-as well as the positive-covered adequately so 

that no one will think that unpleasant facts are being hidden? □ □ 
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In Chapter VII . . . 



• How Test Scores Get into the Media 

• .How to Issue Your District Scores to the Media 

• How to Issue a News Release and How to Conduct a News Conference 

• What Facts All Media Will Need 

• What Questions Arise About Working with the Media 

' ^ Reference Material 

News Release Issued by the State 
Outline-type Model News Release 
Five Model News Releases and Information Memos 
Sample Releases from the Los Angeles Unified School District 
Legal Guidelines on Public Information 
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I J 1 Working with the Media 



In the past, the state administered the tests to try to provide information for a wide range of 
audiences: state legislators, district administrators, program planners, classroom teachers, and the 
general public. In trying to meet the needs of such diverse audiences, ranging fron the need of 
teachers for very specific diagnostic information about students to the more ^t»,.:al needs for an 
indication of education 's attainment statewide, the testing program did none of its jobs very well 

Feedback^ 



On a Thursday morning each November, the 
Superintendent of Public Instruction delivers to 
the State Board of Education a report that will 
soon make its way into the headlines. Then the 
chief of the State Department of Education's 
Office of Program Evaluation and Research faces 
members of the State Board of Education and 
spells out for them the resul-ts of the previous 
year's state testing. He explains the results, suggests 
implications, and answeis questions. In an hour the 
task is done. For many others, however, the task is 
just beginning. 

Within minutes the Associated Press carries an 
account of the. Department of Education's report 
to its subscribers throughout California Gust about 
all daily newspapers, radio and television stations, 
but few weekly newspapers). On the afternoon of 
the same day and the next morning, virtually all 
the n.ajor news outlets in the stats repeat the story 
for their audiences.^ 

The scores of the typical school district find 
their way into the press through routes other than 
these major news media. The big newspapers and 
just about all radio and TV stations concentrate on 
the statewide or big-city district results (which 
they_somelimes„„nep^ori_schooLby_school);.ie^^ 
devote more than a line or two, if that much, to 
smaller school districts. 

Where the Newo Comes from 

How, then, does the press get information on 
individual school district test results? Here is a 
summary of the three ways: 



L From Sacramento: As described previously, 
the major newspapers that cover the State 
Board meetings obtain district-by-district 
scores at the time of the November meeting. 
Others call the State Department of Educa- 
tion and ask that results for the districts in 
their circulation areas be mailed to them. The 
Department fills those requests. 

2. From offices of county superintendents of 
schools. Some news ^media call these offices 
when they hear of the release of scores in 
Sacramento. By then the scores are public 



•^"Purpose of the State Testing ?Togx3im,** Feedback-Newsletter 
of the New California State Testing Pro-am, Vol. I (January, 
1973). 1. 

The speed and accuracy of their reports are no accident George 
W. Neill, Assistant Superintendent of Public Instruction and 
Director. Ofilce of Information/Program Dissemination, says: 
"About d week before the m-wCting, we release the results to the 
reporters who regularly cover the State Board of Education. The use 
of the information, of course, is embargoed until the actual board 
meeting. During that week the reporters have time to digest the 
.nformation an i sit down with us to ask questions and clarify their 
undcrstandipg. By the time of the actual board meeting, many of 
the reporters already have their story written. This arrangement 
-^works.wclLfor-all of.us,** ^ 

News media that usually cover State Board meetings are the Los 
Angeles Times, San Francisco Chronicle, San Francisco Examiner, 
San Jose Mercury-News, San Diego Union, Sacramento Bee, 
Sacramento Union, and the Associated Press. From Mr. Ue'iWs office 
they receive four itemi,: a news release on the statewide test results, 
test scores of school districts in their area, statewide test results, and 
the annual report of student achievement. — ^ — ^ 

Mr. Neilfs office also mails the statewide news release to all 
California news media. The release does not contain test scores for 
individual school districts, A sample of the release is contained in 
thfs chapter. 



information, and the county superintendent 
must give them out.*^ - 

J. From school districts. As reported in the 
survey in \Chapter I, most newspapers and 
other media\get test results from the school 
district office. Some districts release their 
districtwide ano. school-by-school results on 
the day of the St\te Board meeting, especially 
in areas where major newspapers are going to 
run them anyway \)thers wait until a later 
time, perhaps when th\scores are reported to 
the school board. 

Thus, by knowing just when tfi^ State Board wi 
receive the results and knowing^Nhow the news 
media in a particular area usuallXobtain their 
information, you can plan ahead for the most 
effective release of your district's results/ 

I 
\ 

Four Easy Ways to Get the News Our^ 

The next job is to communicate the informatioi" 
to the news media— the newspapers and radio and 
television stations that usually cover your area. If 
the district has a public information officer or a 
part-time consultant in public relations, no prob- 
lem should occur. One should simply give that 
person the information and let him or her do the 
job. For districts without this advantage, however, 
four easy alternatives ar^ available for doing the 
job oneself: 

• Alternative 1: Issue a News Release, Write a 
news release in journalistic style that contains 
all the information the news media will need 
to report adequately your district's test 
lesults. Then either mail it to reporters or 
hand it to them as they attend a board 
meeting. (Reporters usually do a better job 
when they have plenty of time. Since test 
results are important news, it is a good idea to 
telephone reporters before a board meeting is 
held or before a news release is mailed. 
Reporters may even want to pick up a copy 
to study in advance on a hoh'-for-release 
basis.) See the. resource material in this 
chapter tor model news releases that can be 



adapted. A news .elease or information memo 
slrmllcPbir^kept"~stinple. ^Professional jargon 
should be avoided. If your next-door neighbor 
cannot understand the news release thor- 
oughly, the media are not likely to either. 

• Alternative 2. Issue an Information Memo. 
Tliis alternative may be a better method for 
Inose who are not familiar with journalistic 
writing. The memo is simply an organized 
summary of all the pertinent details. It 
contains the same information found in a 
news release but is not written in paragraph 
form. See the resource material in this chapter 
for some examples. The memo can also be 
mailed or handed to reporters. 

• Alternative 3. Use Your Board Report. In 
some cases the report you write for your 
school board will give reporters all the infor- 
mation they need. Of course, they can get a 
report when they nttend your board meeting 
or, perhaps, from you ahead of time on a 
hold-for-use basis. Be sure, thougli, that the 
report contains all the information the 
reporter is likely to need. Not all school. board 
reports do.^ 

^^Alternative 4. lie J a News Conference. Some 
big-city districts use this technique because 
thev (1) have many newspersons who want 
their\;esults at the same time, (2) want to 
avoid ahswering the same questionsTor several 
different\eporters; (3) need to let television 
and radio rc^^orters film and tape their super- 
intendent announcing the results; ind (4) 
want to break r^e news to all the local news 
media at the samevtime. A news^eon fere nee is 
useful when reporters^ask many questions or r 
need exists to clarifjN^ number of difficult 
points. A conference is nb^ useful for a simple 
release of information. 

These four alternatives take in t\k account the 
diversity of situations in California sclmol districts. 
Where there are only one or two local ii^s media 
and the testing coordinator or superintena)ant has 
the facts^ well in a telephone call cah be 

sufficient (from the superintendent to a reporte 



Sec this chapter'.^ resource materials for legal aspects uf public 
information. , ' 

^Tliis njcctingis usual!> licid in the first half of November each 
year. The exact date on which the test results will be reported 
be learned by calling the State Board office in Sacramento 
(9I6*445-90I6) a few wecksjbcforc the meeting. 
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Takmg a cue from Sacramento, one smart tcstmg director calls 
up each loeal reporter the day before she reports test results to her 
school board. Slie invites the reporters to stop by her office well 
before the meeting. At that tmie she gives them a copy of her new.s 
release and board report and spends time discussing and clarity ing 
(he meaning of the scores. The result is fewer problems at the board 
meeting and better news reporting. 



"Hello, John? I just wanted you to know that we 
are releasing our annual pupil testing results today. 
Shall I mail them to you? Or, if you like, you can 
drop by, and Til be glad to go through them with 
you in detail." 

Five Things All Reporters 
Will Want lo Know 

Regardless of how testing results are released, 
most reporters are interested in knowing five basic 
things. Be sure the five things are contained in all 
news releases, information memob, or board reports 
that are distributed to the media. If you are dis- 
cussing results with a reporter, know the results 
thoroughly before you start. 

L What are the test results? How does the 
district compare with other districts in the 
state? What are the percentile scores for each 
grade? Where do the percentile ranks fall in 
relation to the comparison score band? 

2. How do the test results compare with last , 
year's results? Is the trend up or down? 

3. If the trend is higher or lower, what is the 
reason? Budget cutbacks? A new reading 

. program? Shorter instructional periods? A 
redesigned curriculum? 

4. What are you going to do with the test 
results? A new program of some kind? Reallo- 
cation of funds? A new task force? If so, 
when will the public see these things material- 
ize? 

5. How do y ou feel about the tesh<esulis? If you 
are pleast d, say so. If you are nor, it's good to 
express your concern. 



Once you have covered the basics, some 9ther 
information may be useful: 

a. Particularly high- or low-scoring schools or 
grades 

b. Unusual increases or decreases in scores 

c. Number of children in the district taking the 
test 

d. Purpose of testing 

e. General level of scores statewide 

f. Background information about the nature of 
group testing, the meaning of average scores, 
method of determining the comparison score 
band, and some of the significant background 
factors in a school district 

g. Members of the district' staff responsible for 
improvements 

QuesiionsAboul Working with the Media 

Q. What should be done by a district in a 
metropolitan area lacking a local community 
newspaper? ("All we get are a couple of lines in 
the metropolitan newspaper.") 

A. For convenience' sake the major news 
outlets probably get the scores from the 
office of the county superintendent of 
schools. (Check if you are not sure.) This 
situation implies (I) that a need exists to 
communicate with the community directly 
(via newsletter, for instance) rather than 
through the media; and (2) that the metro- 
politan press and radio and television sta- 
tions are likely to be interested only if 
something unusual is present; for example. 



How to Issue a News Release or Information Memorandum 

(Basic Teehnique ) 

Write or compose the release or memorandum and type a clean copy on 81// x 
1 1" paper. Check the copy thorouglily for accuracy (no guessing permitted). Xerox 
or Hthograph enougli copies (no carbons). Then either (1) mail them in regular 
business envelopes via first-class mail to all local news media, or (2) hand them to 
reporters. Be sure everyone gets his or her copy at about the same time. No 
favoritism should occur. Keep a copy tor the file. 

News releases and information memos (because they are complete and easy to 
read) are useful also to staff members, telephone cle ks, principals, PTA officers, and 
others. Bulletin boards can be used effectively for tliis purpose. 
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a rapid gain in reading directly attributable 
to a specific program. 

Q. Our .district scores always appear in our metro- 
politan newspaper the day after -the State 
Board meeting. What should we do about our 
community newspaper? 

A. Jack McCurdy, education writer for the 
Los Angeles Times, says: **Any reporter of 
a community newspaper is going to be 
upset when he sees his scores for the first 
time in the Los Angeles Times, When I was 
a smalMown reporter, I had more respect 
for public officials if they came to me first. 
Regardless of whether you have something 
serious to say, not making a public state- 
ment makes it appear that you're trying to 
liide information. You start off on the 
wrong foot.'' McCurdy urges such districts 
to release their results on the same day as 
the State Board meeting. 

Q. Who should speak for the district through a 
news release or information memo or at a news 
conference? 

A. The superintendent. According to Reh.as- * 
ing Test Scores, a publication of the 
National School Public Relations Associ- 
ation, **The superintendent can and should 
defer to experts when questions get techni- 
cal, but the superintendent is the spokes- 
-man the media wants.'' 

Q. What tone should statements or news releases 
take if a district's scores are low or doing 
down? 

A. Be factual. Report the full information and 
be sure to say what you intend to do about 
it. McCurdy of the Los Angeles Times sayc. 
*The most important thing is to try to 
maintain an objective point of view. No 



matter what the results show, the reporter 
will respect the fact that a school district is 
at least capable of taking an objective look 
at itself." 

One school public relations professional 
advises: **Most people are reasonable. The 
pubUc doesn't expect us to be perfect, nor 
to perform miracles. It does, however, 
expect us to be realistic, to face up to 
problems, and to come up with feasible 
plans for solving them. Tliis is the view- 
point you must communicate. It won't do 
to be stumped or astonished by test scores. 
Think of the movies: the bad guys alibi; the 
gpod guys act." 

Releasing Test Scores comments: "Some 
educators have argued forcefully that 
assessment test scores are an insignificant 
measure of student achievement. (Such 
arguments generally follow the presenta- 
tion of low scores.) This *cop-out' approach 
to assessment just doesn't work. As far as 
the *outside world' is concerned, tests 
wouldn't be used if they didn't mean 
anything," 

Q. What should I say, however, if I am sure the 
results of state testing do^ not show the real 
acliievement levels of my district? 

A. It is time to cite in detail other tests or 
assessments done in the district and to 
show in what way they differ from the 
state test results. It is not persuasive, 
however, to claim that the state test results 
are inaccurate unless hard data are at hand 
to support your view. 

Q. There are some reporters I hardly ever see at 
our school board meeting. Do I need to send 
them Qur results, too? 



How to Conduct a News Conference (Basic Technique) 

Notify all local news media a day or two in advance. Hold the conference in a 
suitably large room if there will be television cameras, otherwise, an office or small 
room will do. Start the conference by handing out the test scores in the form of 
statistics, summaries, charts, tables, or narrative. Read or ad-lib a statement on how 
the district views the scores, what it plans to do about them, how it plans to use 
them, and so on. (Don't read aloud the written material you have just handed out.) 
Answer questions until all present have the information they need. 
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A. Rule one in getting along with representa* 
tives of the media is to give all reporters an 
equal break at the news. Be safe. Send your 
information to ?ll media that may possibly 
be interested. 

Q. How should I get testing information to the 
broadcast media -radio and television? 
A. Do the same as with newspapers. Send the 
same material (news release, information 
memo, and so on) to all news media. 

What Else? 

Don't talk about test results only once a year. 
Whether your results look good or bad, it is to 



your district's benefit to discuss them several times 
a year. Two ideas: 

• If in November you talked about new pro- 
grams,^ keep information coming during the 
winter and spring on how the programs are 
doing. The resource material for this chapter 
contains a sample news release and informa- 
tion memo on this matter. 

• Let parents know when their cliildren will be 
tested. Perhaps you -can give them the test 
schedule fqr the year. Sample news releases 
and information memos on these topics are 
^also contained in the resource material for 
this chapter. 
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Resource Material for Chapter VH 

The Slate News Release 

This is a copy of the news release issued by the Department of Education at th 
time scores were reported in November, 1974. 



CALIFORNIA STATE DEPARTHLiNf OF EDUCATION 
Wilson Riles 

Superintendent of Public Instruction 
721 Capitol Mall 
Sacramento, CA 95814 

Contact: George Neill 

(916) 322-6140 



#184 



11-13-74 



RELEASE DATE; 9 a.m. Friday, Nov. 15 



SACRAMENTO Pupils in California's 2nd and 3rd grades scored above the 

national average in reading last year, but the state's 6th and 12th graders 
perfornied below the national average in all subjects included in the statewide 
testing program. 

Alexander I. Law, chief of the State Department of Education's Office of 
Program Evaluation and Research, told the State Board of Education today 
(Nov. 15) that the 1973-74 test results disclosed that California's 2nd graders 
performed 3 percentile points better in reading than the national norm. 

The average reading test score for the third grade was 2 percentile points 
higher than the national average. 

The new test results, which involved 1.5 million pupils, also revealed a 
slight performance decline from the 1972-73 school year by 6th graders and 
high school seniors in reading, writing and spelling. However, Law said, 
"there is evidence that the downward trend in the 6th grade has been halted." 

Other highlights of the test results: 

• High school seniors scored 16 percentile points below the national 

average in writing and language skills; 6th graders were 13 percentile 
points below the national average in the same skill area. 

9 The average score in reading of high school seniors was 3 percentile 
points below the national average; 6th graders were 6 percentile 
points below the natioi^?J norm in reading. 

more — 
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• The average score of high school seniors in mathematics was 2 
percentile points below the national* average, the same as 1972-73; 

6th graders were 12 percentile points below the national mdth averaqe, 
no change from the year before, 

• High school seniors scored 3 percentile points below the national 
average in spelling; 6th graders were 8 percejitile points below the 
national norm in spelling, 

"The greatest weakness appears to be in the area of lanauage and writing," 
Uw saio. He noted that both the 6th graders and the 12th graders scored 2 
percentile points lower than 1972-73, 

Because of the size and heterogeneity of California's population, the 
hiah average score for the state in the 2nd and 3rd arade is "remarkable," 
Law said, 

"The emphasis on improving the instructional program in the lower grades in 
the past four or five years is payino off," he added. "Similar emphasis wilJ 
be placed on the higher grades durim the next two to four years as a result 
of the efforts of the Reform of Intermediate and Secondary Education (RISE) 
program launched last July by Wilson Riles, state ^superintendent of public 
instruction " A special RISE commission is at work now developing a program to 
overhaul the state's junior and senior high schools. 

Law said the test results indicate that: 

• Pupils who had attended preschool s scored higher than those who did not, 

0 Pupils in medium-sized Schools scored higher than pupils in small | 
and lar^e schools, 

• Pupils who attend suburban schools scored higher than pupils In both 
rural and urban schools, 

e Pupils whose parents were employed in professional fields scored 
higher than pupils whose parents were employed in skilled or 
semi-skilled occupations, 

more— 
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Law said no other state conducts ^uch a* comprehensive testing program. 
California is the only state that tests five grades annually, he jdded. 

The test results include a breakdown by school districts, Law said. 
Each district has received its average scores in each subject area tested, 
and the results are compared with state and national norms. In addition, 
an innovative Index added last year 'provides each district with a 
comparison of how it is performing in relation to districts with similar 
pupil populations. 
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An OutHnc-Type Model News Release 

This model of a news release is provided to school districts in Los Angeles County 
by Ann Barkelew, Public Information Officer in the office of the county 
superintendent of schools. To use the model, districts fill in the blanks j/ith 
information on their own results. 



Name of district 

Title of oficc sending news release 
Na.-ne of cc.itacc person 
Telephone r.u.T.ber cf coniact person 
Date of news fetease 

HEADL INE (op t ior.ol ) 

Superintendent , School 

District, today announced achievement test results for the district's 
pupils in grades ], 2, 3, 6, and 12 that have been released fr<?m the 
State Department of Education. The tests were a J'n i n i s te red during the 
lS7^-75 school year as part of the mandated statewide testing pro am. 

THEN -Summarize the practical significance of test results. 

Include comparisons over previous years, using <;uotatlons 
from the superintendent. 

Basic reading achievement of students in the grades tested (has 

district's 

continued to improve( (h;^s remained constant) during the past few years. 

said, " 



Superintendent quotation on general trend 

NOTE - If one of these two statements cannot be made, start 

paragraph by breaking down the general trend into grade 
1 evel s . 

Third graders showed the most significant gains in basic reading achieve- 
ment with 



ALSO 



Indicate any test changes that make certain specific 
raw scores comparisons difficult. 



KEEP \Jl 
MIND 



Sometimes numbers are easier to understand 'than 
percentages. For example, to say that 5,000 twelfth 
graders are reading at a higher level than +he "average 
twelfth grader In California means more than to say 
that 43? or less than half of. the twelfth graders are 
doing so. 

Often, the display of a tJSree- to five-year span can 
demonstrate trends significantly. 
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N£Xr -Identify the tests used and how they are 

^ administered. Were all students at each 

^> grade level tested or was matrix sampling 

used? Explain briefly. 



ALSO -Point out specific are&? of Instruction and \— 

learning measured by this battery of tests, 
highlighting what Is not measured* 

-Define "norms" or state averages and explain 
APPLICABLE how they are determined. Spell out limitations. 

NEXT -Explain the Intent of the state testing program. It 

may be wise to use quotation from state department 
official or county schools office person* 

FINALLY -If you are pleased with the test resuMs, say so. 
If not. Indicate your concern. Oon*t become 
defensive. Above all, be open. 



ADDITIONAL COPY IDEAS: 

...Give your staff credit for what they are doing to help raise test 
scores . 

. . . l^iJen t i f y programs that have been initiated jduring the current year to 
acceleraterea-'ingprogress. / 

...Outline new programs (or types of increased Instructional support) 
that ore needed to improve performance. Cost of these new efforts 
should be stressed. 

...Report on special norms (national norms for ESEA Title I pupils, for 
example) that match grades 5r schools in your district mo re closely. 

...Stress and document important learning outcomes no*" measured by 
standardizedtests. 



1. 
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-Several Model News Releases and Informalion Memos 



This resource material in this section contains 
models that can be usetl^ on five occasions Huririg 
the year: 

• Models la and lb. Tp announce. the release of 
test results (This model Ms somewhat long 
because it is intended tQ present most kinds 
of information tlfat a school district Js 
required, to -report. .The version used by a 

^ particular district nfiglit be much' shorter. 
Model .i<a is followed b> fhroc alternative 
beginnings for the saine release for use in 

• different circumstances.) 

• Models 2a and 2b, To announce the ^art of a 
program to coirect'areas in which widents < 
had received low test scores * 

" • Models 3a and 3b, To follow up ^^everal 
months later on new progf^ams your district- 
^--^ had put into effect 

• .Models 4a and 4b, To announce your. dis- 
trict's testing schedule at the beginning of the 
scjiooi year 

• Models 5a and 5b, To announce upcoming 
testing two to three weeks before each test 



SOTL, Items a and b in each set contain the 
same information, a is in the format of a news 
release; b is in the format of an information memo. 
See the text of this, chapter for the way to use 
each. 

In addition you need to keep the following in 
mind wiien you use the model news releases and 
information memos: 

1. These arc only models. Be sure to, substitute, 
your own information. Change the wording or 
paragraph order wherever necessary. Add 
other kinds of information and details as 
appropriate. 

' 2. Do not use the quotations. They are used 
only as models. Put your own comments and 
interpretations in your own quotations. 

'I 

3. 136 siixQ olher r\earby school districts are not 
sending sim^h/^ounding news releases to the 
same news media that you are. If sp, change 
the 'Way your information is worded so that 
n ws media v/ill n.ot get identical news releases 
from^two school districts. 
' ^ " / ^ 
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UloDia UaU'iod School District 

300' y^dxi St. 

Utopia, Calif. 

777-1234 

11-15-78 



Contact; John iU Doo 

Super intendeni of Schools 
. ' 777-1234 



Modei la 



GAINS, LOSSES BOTH SFOVm IN ; 
UTOPIA SCHOOL DISTRICT SCORES- 



Tor lEsa^diete Keleaae 



Pupil achievement In the Utopia Unified School District rose this year in ^ 
some subject ar&as but declined In others, according to new state testing 
figures released today (Nov. '15). 

Superintendent of Schools John A. Doe said 'most elementary grades showed 
improvement over idst year, but grade 12, achievement leyels went down* Overall, 
he said, ''achievement In the«Utopla school district remains a lirtle below the 
average of the rest of the state." 

The tests were conducted l?iat school year dn grades 2, 3, '6 and 12 in all 
Utopia district schools. In all, about 6,500 pupils were tested. . • ' \ 

Following are the percontile scores for each subject tested and lest y.ear^s 
score- for tho^ssco area: j 

^ 1976 f 1975 ^ 

44 , '39 
\51, 50 

48 4S • 

'52 54 
.41 39 



Grado 2 reading 
Grade 3 reading 
Grade 6 reading 

vrritten expression 

spelling 

mathematics 



-*lCfO-. 



ERLC 



82 



VII-13 



QairJif Losses Both Shown in Kew 
Utopia School DistrictfScores 
2^-2-2-2-2-2 

Grade 12 reading AO 44. 

written expression 42 50 

spolUng 47 49 

aathcnatics 55 ,51 

The percentile score shows how pupils in that particular grade compare 
with pupils across the rest of the state. For example, a score in the 48th 
percentile means that the average Utopia pupil at that grade level did better 
than 47 percent of the average pupils in other California schools at that 
grade ievel^'but more poorly than 52 percent o.f the pupils. (The 50th per- 
centile Is considered average.) 

Dr. Doe sajd that while the school district staff is pleased with the 
improved achievement in elementary grades, it is very concerned about the 
grade 12 scores. There i^ particular concern, he said, about the, grade 12 
students* achievement in reading ind written e:cpression. 

"It appears that changes are needed at once in the way these subjects are 
taiight and, perhaps, even in the curriculuni and laaterials used in the classroom," 
said Dr* Doo. 

This week Di'. Do& appointed a 12-ncmber staff task force to look into ways 
this part of the high school prog:raia can be improved im-iediately. The task force 
will naka its report at the Doc. 2 meeting of the Utopia Board of Education. 

Dr. Doc said he will present rococcendations to the board then for i.*aediate 
steps, possibly including the diversion of funds froa soae other budget area^ 
into the high school English and reading programs. 

These subject areas also will get priority consideratiop^ when the 1977-78 
budget is drawn up this spring, the superintendent said, 

"This is the first year in the last five that gra4e 12 scores have declined 
this rapidly," said the superintendent. **WlUle this is i\ot serious enough yet 
to bo callod a trend, we oust york on it before it does becoDS a t>rend hci^," 
^ ••ciore** 



\ 



Gains, Losses Both Shown in Mew 
Oiopia School District Scores 
3-3-3-3-3-3-3 

At tho sanjc tine. Dr. Doe caid increased efforts by elenontary teachers 
appear to be paying off. 

He gave credit to the teachers for their six-week study last winter, which 
resulted in the adoption of new to an- teaching pro grans at three elementary 
schools and the creation of specialized reading libraries at two others, 

"Our acK3evenent in th» elementary grades Is not yet as high as we would 
like xt to be," he said, "but I believe we have built a. firm base for continued 
inproveccnt," 

The state testing program also shows whether a school district's average 
scores in each grade are above » within» or below expectations for the district. 
Background factors considered are test scores In lower grades, number of bi- 
lingual pupils » and socioeconomic conditions of the community. 

Utopia scores were above expectations in grade 2 reading, grade reading and 
spelling! and grade 12 mathematics. They were within expectations in grade 3 
reading* grade 6 written expression, and grade 12 spelling. They were below ^ 
expectations in grade 6 mathematics and grade 12 reading and vnrltten expresslonT^ 

The state analysis showed that the Utopia School District Is higher than 
the state average in socioeconomic level » the level of parent education, tax 
rate, and expenditure per schoolchlld. It Is below the state average in the 
number of bilingual children, minority children, and class sizes. 

The scores reported here are the averages for all Utopia children at each 
gi-ade level. Many schools or classes, of course, scored highei or lower than 
the district- wide averages. Scores of individual pupils are not ccaputed ty tho 
dtate* 

Sone of the najor inprovenents shown in this yearns testing are: 
— Sixth-grade reading scores at Washington Elementary School rose this year 
fron the A5th to 66th pcrceatilo. 



-more- 
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Gains, Losses Both Sr.own in Kcw 
Utcpia School ''^.strict Scores 



— Grade 2 children at Jefferson Elementary School — who ore in a teacv- 
teaching pro^aia— showed inprovements in reading fron the 24.th to ^'^th percentilet 

— Grade 12 students at Hardlton High School continued high achieveoent in 
aathenatics, going froai the 57th to 67th percentile* 

Grade 12 students -are tested each December, and those in grades 2, 3 9 and 
6 are tested in April and Hay« 
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Olher Be<;innin<r$ for >Jo(lel lu 



Depending on your circumstances, this same^ews release could also begin in 
several other ways. Here are three other possible 'SegirmTligs: 



AC!JiEvsj:i2rr scores in i-cst 

GRADES in UTOPIA SCHGCL DISTRICT 

Pupil testing scores genera] ly declined in both elementary and secondary - 
grades this year in the Utopia Unified School District, the result of continued 
cutbacks in staff and materir^ls. 

There were, however, :eral bright spots a:aong the generally disappointing 
test results, according to Superintendent of Schools John A. ^oq. 



PUPIL ACHISVS!SJT SCOPiS LHTvSL^ OFF 
IN UTOPIA SCHOOL DISTRICT 




Recent declines in pupil achievement scores in 


the Utopia Unified School 


KLstrict seen to have been stopped, with some grades 


even shc\/ing gains, according 


to new scores reported today'. 





HIGHKR ACHIEV^^Sl.T REPORTED lU 
KOSH GRADES IK UTOPIA SCHOOLS 

Kost pupil testing scores have risen to their, highest levels in the last 
four years in the Utopia Unified School District, according to new results reported 
today. 
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Utopia Unified School District 

300 N. Main St, 

Utopia, Calif. 

777^1234 

11-.1-3-76 



Model M) 



For more inTormation: 
John A. Doe 

Superintendent of Schools 

777-1234 For Imaediate Use 



Hews Inxorr>ation IfeTOrandua 
on Nev Utoola School District Test Scores 

1. About Che new scores ; We are announcing the results of pupil testing 

conducted earlier this year In the Utopia Unified School District* 

To susmarlze^ pupil achievement rose In some subject areas 
but declined In others. Most elementary grades showed improve- 
ment over last year» but In grade 12 the achievement levels 
went down. Overall, achievement levels remain a little below 
the average of the rest of the state. 

2» The nev fir^ire st Here are the percentile scores in each grade and subject, 
along vith the sane scores for last year: 





1976 


1975 


Grade 2 reading 




4f 


Grade 3 reading 


a 


39 


Grade 6 reading 


51 


50 


written expression 




43 


spelling 


52 


54 


BLS hematics 


a 


39 


Gniue 12 reading 


40 


44 


written expression 


42 


50 


spelling 


47 


49 


matheiaatics 


55 


51 



-more— 
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News Information Keiao on 
School Test Scores 
2-2-2-2-2-2-2 



(The percentile score chows how pupils in that particular grade 
compare vich results across the rest of the state. For example* 
a score in the 48th percentile means that the average Utopia 
pupil at that grade level did better than the average pupil In 
7 per cent of other California schools at that level, bet more 
poorly than 52 per cent of the pupils. The 50th percentile is 
considered average) 

3. Hoy ve interpret the scores ; Our school district staff is 'pleased with the 
improved achievement in elementary grades. But they are very 
concerned with the grade 12 scores, particularly about the grade 12 
achievement in reading and written expression. It appears that 
changes are needed at once in the way these subjects are taught 
and, perhaps, even in the curriculum and materials used In the 
classroom. 

This is the first year in the last five that grade 12 scores 
hav^ declined this rapidly. While this is not serious enough 
yet to be called a trendy ws: must work on it before it does 
4 become a trend here. 

Actions beipf^ taken ; Several steps are being taken in regard to the new scores: 

— A 12-iiiembcr staff task force was appointed xhis \/eek by Dr. Doe 
to look iato vays this part of the high school program can be 
improved irciediately. The task force will make a report at 
the Dec. 2 meeting of the Utopia Board of Education. 

— At that ineetint,, Dr. Doe will present recoianendaticas for 
immediate action. These may include diverting f\inds from 
other budget areas into Idgh school English and reading. 

— Also, these subject areas will get priority consideration when 
wc draw up next year's budget this spring. 

5» Some pood n<>vs ; The improved elementary scores appear to be the result of 

the six-week study conducted last winter by our elementary teachers. 
As a result of that study, we adopted new team-teaching jjrograms 
at three elementary schools and created specialized reaching 
libraries at two others. 

Our achievement in the olsnentary g^^tides is not yet as high os we 
would like it to bs, bat I believe* we have built a firm base for 
continued improvement. 

We had these examples of major improvements diis year in ooir 
scores: 

— Sixth-grade reading scores at Washington Slcmentary School rose 
from the 4.5th to 66th percentile. 

— Grade 2 children at Jefferson Elementary School increased their 
reading scores from the 2/*th to l^lh percentile. They are in a 
teanuteaching program. 
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— Grade 12 students at Hamilton High School continued high 
achievement In aatheoatlcs, going from the 57th to the 67th 
percentile. 

6. Background factors In testing ; Besides the percentile scores above, the 

state also shows whether scores In each subject are above, within, 
or below expectations for each district. They base these ex- 
pectations on, a number of background factors for each school district. 

Here Is how Utopia stood In relation to the comparison score bands: 

Above expectations: grade 2 reading, grade 6 reading and 
spelllv2, grade 12 mathematics. 

Within expectations: grade 3 reading, grade 6 wrlttea ex- 
pression, grade 12 spelling. 

Below expectations: grade 6 mathematics and grade 12 reading 
and written expression. 

In the most Important of those background factors, Utopia was: 

— Higher than the state average in socioeconomic level, level 
of parent education, cax rate, and expenditure per child. 

—Lower than the state average in number of bilingual children, 
minority children, and average class size. 

7. Background on testing : The figures reported are the average for all Utopia 

children at each of the grade levels reported. Naturally, many 
schools and individual clarses scored higher or lower than the 
district average. The state doesn*t compi*ie scores of individual 
pupils . 

/ The testing took place at the following times: grade 12 in December; 

i grades 2, 3, and 6 in April and Kay. 
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Contact: John A, Doe 

Superintendent of schools 
777-1234 



UTOPIA SCHOOL DISTRICT TO LAUNCH 
NEW READING PROGRAM 



For Imaediate P*elea39 



A new readir.g program aimed at second- and third-grade pupils will be 
put into use next month at all eight elementary schools' in the Utopia Unified 
School District. 

The program is intended to raise the low reading achieveiaent levels in those 
grades reported in last month's state testing restilts, according to Superintendent 
of Schools John A« Doe* 

"This new program is the result of three weeks of study by teachers and 
our curriculum specialist into the fastest ways of attacking the reading needs 
of these children," the superintendent said. 

"This is not all we are going to do about early reading, but I feel that 
imaediato steps are needed right away." 

The new program, celled the Utopia Reading Clinic Program, consists of three 

t 

m&ln parts: 

— The establishi'cent of reeling clinic rooms at oil eleaentary schools, to 
which second and thit»d-grade pupils will be assigned for 1-^ houn* a day for 
iipecial reading exercises, 

— An increase in the daily tiae spent in reading and Wilting in those grades 
from 3j to 5i- hours. 

^ — The imaediate purchase of $15,000 in a • ariety of reading exercise sots 
and writing practice books. 
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I>r^ Doe said the new program was approved in principle at the Nov. 2il 
meeting of the Utopia Board of Education. Transfers of funds totaling $18,500 
to s 1:9 port the progran will be submitted for approval at the boaru's cext 
meeting^ Dec. 16. 

Other steps to ixoprove reading will be planned during the next two uionths bf 
a comnittoe of teachers, pavsnts, and other school d. strict staff Eeabers* 

"These will likely require much greater expenditures than our immediate new 
program," said Dr. Doe. "Recojn.'scndations growing out of the cocnittee's work 
will bo the basis for greater reading expenditures when we draw up our budget 
this spring. 

^^We have no money to- spare in any part- our budget, and the finandel 
situation is Hkely to get worse. But we must put the impprtant trdngs flrst> 
ar*d reading is certainly one of them," 

m 
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For more information: 



John A* Doe 

SuDerintsndent of Schools 
777-1234 



For Immediate Ude 



News Information Meniorandiia on Noy 

C 

RaadinR ProRrea in Utopia School District 



1. The nev program ; Today, we are announcing the start of a new reading program 

for all grade 2 and 3 pupils In the Utopia Unified School District. 
It will go into effect next montli In all of our eight elementary 
schools, Q J ^ 

2. Prcrras details ; V/e are cl^^ling thc^xf^grtm the Utopia Reading Clinic Progranu 

These are its wi?0c^jiatin parts: * 

— The establishicent, of reading clinic rocc:s at all elementary 
schools I to which second and third-grade pupils will bo assigned 
fcr 1^ hoars a day for special reading e^asrcises. 

— An'^increase in th^ daily time spent in. reading and writing in 
Grades 2 and 3 from 3^- to 5^ hotirs. 

I 

— The i2i2ediate purchase of $15,000 in a variety of reading 
A exercise sets and writing practice books* ^ 

3. Other steps : We will bo planning- other steps during the next two months to 

improve reading. This planning vill done by a comaiittee of 
teachers, parents and other sch/^ol district staff members. 

These steps are liKely to reqvdre much greater expenditures than our 
im.7Jediate new program. Hecomnendaoions growing ^out of the ' 
committee's work will be the basis for greater reading expendi- 
tures when we draw up oiir budget tiiis spring. 

Ve have no money to spare in any part of our budget, and the 
financial situation is likely io get worse. But we must put 
iaiportant things first^ end reading is certainly one of then* 

4. The reasons ; This new prograaPls Intended to improve the low reading achieve- 

ment levels thatSjere reported last month In the state testing : 
results for grades 2 and 3. , - 
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ficus Infornatlon Reno on 
Kew Roading Program * 

, / , . ' 

5. Background on- the new progra m; The .program is the result of three weeks of 

study by teachers and our district's curriculum specialist as 
to the fastest ways of meeting the reading needs of these children* 
This program>is not all we are going to do about early reading, 
but I feel that Issmediate steps are needed* 

6, Beard of education action : The new program was approved in principle by the 

board of education at its Nov. 28 meeting. At its next meeting, 
Ibc. 16, I plan to ask for transfers of funds totaling $13,500 
to support the new program* 
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Utopia Unified School District 

300 N. Main St. 

UtoDia, Calif. 

777-123/* 

3-10-77 



Contact: Kary Jones 

l>irector of Curriculua 
• 777-123/r 
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MA-niEiailCS EFFORTS OU IKCRSASE 
IM nOOPIA SCHOOL DISTRICT 



For Iicsediate Roleast^ 



Greater attention is being given to high-school natheriatics instiiicUoa this ^ 
year in the Utopia Uni'fied Schc lUstrict than ever before, according to Director 
of Ciirriculum Mar/ L. Jones. 

She said the new efforts — prompted by declinir5 achievement scores JLast 
•fall — seea to be working. 

Since beginning a now high-school mathcniatics iiaprovcaent program la«t ' 
Deceniber, the school district has: ' 

— Increased natheaatics ,stu^* time by one hour a 3ay» 

— Given Doathly progrossf checks to all students enrolled in nathsniatics 
classes. • ^ ^ ^ • 

— Purchased an additional $9,500 in mthenatdcs books, stutfcr. guides and won 
books* 

— Put into use p^irts of the highly respected Ajax I^theciatics Procraa^ 
designed by^ educators at the University^ of Michigan* 

Mrs. Jones said the efforts seem to be paying off* Some 72 percent of the 
school district's 3,868 mathematics students have shown Improvement In the 
monthly progress testJi, Of this number 1^2 (A2 percent) have shown an achleve- 
mcnt gain of at least ten months during ^ the six^months the prograij has been 
In opetatl'bn. > ' 
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yjiV.iemaiics Efforts on Jncreasa 
in Utopia School lUstrict " 



"There Is no doubt that this ia?>roYecent. ie cJirectly attribixtable to the 
new prograa," said Mrs. Jones, °Our task now is to keep the students* intereat 
in nathematics high and to see if we can continue to raise their achisveaant a 

A 

substantial arount each nonth. " ^ 

"It IS probably too early to say that z\ie prograza is totally 'successful, 

but all the indications we have seen so far are pcsitivo.^ 

The new effo^ts^a^e being made in both hlgh*schools In the district, 

Washington and Jefferson, and are directed by the chairperson of the mathematics 

department at each school. 
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300 Kain St* * 
Utopia, Calif, 

777-1234 
3-10-77 



Model 



For aorc inforaation; 



Director of Currictilm 



For Imraodiato Usf 



News Infomation Meaorandui a 
on Utopia Schools' Math Efforts 



The basic infomation : Last Doceiaber, the Utopia Unified School District 
greatly increased its efforts in the areata? high-school 
Batheniatic3# Nov it appears tha"c those efforts arc having a good 
effect on student ncliicveaent; 

2. BacV;?roi>n d inforaation ; The jlncfeased efforts were put into effect after 

.state testing results last fall .showed that Gr^iSe 12 mathematics 
achievenent here was declining^ These steps wbre taken: *' 

— Mathematics sf»:cly time was increased one ho\ir a daly. 

— Monthly progress checks were given to all students enrolled 
in matheaatics classes, 

— An additional $9300 in mathematics books, study guides and 
work books was purchased. • ^ 

— Parts> of the highly respected Ajax Mathematics Program, designed 
\rj educators at the Univerd ty of l-iichigan, were put into uco. 



With all th^se, greater atftention is bcin^ givs?n to high-school 
mathcmat5.cs instruction tVlis year than ever before in our school 
district. 



3. The resii 



The results have been very positive. Of our 3,868 mathematics 
students, 72 percetit have shown improvement in their monthly 
^progress tests. Of these 1,622 (42 percent) have shown an 
^ achievement gain of at least 'ten moritKs during Che six months 
the program has been in operation, Theria is no doubt that this 
improvement is directly attributable to' the new prograia. Our 
task now is to keep the students' Interes't in matheaatics high 
and to see if we can continue to raise their achievement a sub.- 
stantial amount each month. It is probably too early to say --^ 
that the program is totally successful, but all tfie indications 
we have so far-are positive," 

4, About the program; The program is being used at both of our *high schools, 

Washington and Jefferson, 2nd is directed at each school by the 
chairperson of the mathematics* department, 

* t * * 

m 



96 



VII-27 



Utopia Unified School District 


< 




500 :U Kain St. 
Utopia, Calif. 
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Contact: John A. Doe 

Supcrintendoat of Schools 
777-1234 






\ 

TisTI^;G SCHSDULE A:J!X)UNCSD IN 

UTOPIA SCHCOL DISTRICT For Immediate Relcaaa 


\ 

\ The 1977-78 pupil testing schedule in the Utopia Unified School District 


was announced this week by Superintendent of Schools John A, Doe» Pupils will 


be gi"^,en sT.ate-required tests as follows: 






Grade 1 — Week of Sept. 18^ 






Crkc 12 — We^k of Jan. 12, 1979. 






Grade 6 — Week of April 2S-Majr 






Grades 2 and 3 — Week of May lA, 






Testing will take place in each pupil's regular classroom or homeroom. The 


tests will require from 30 to 40 minutes to complete. 






The testing is required by the state to ineasure the effectiveness- of school 


pro^raas and pupil achieveaaent throughout the state. Results of this year's 


testing will be reported by the state in Noveaber, 1978» 
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Utopia Unified School District 
300 N. Kain St. 
Utopia, Calif. 
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For more information: 



John A. Doe 

Superintendent cf Schools 
777-1234 



For Imnediate Use 



News Information Meaorandua 
on Utopia School District Testing Schedule 



1, Tho activity : We are announcing the 1977-73 testing schedule for aH pupils 
in the Utopia Unified School District, These are tests required 



The schedule isi 

Grade 1 — Week of Sept. IS, 1977 
Grade 12 — Week of Jan. 12, 1978 
Grade 6 — Week of April 26-May 4 
Grades 2 and 3 — Week of May lU 



2. About the tests: Each child will take the test in his or her 'regular 



classroom or homeroom. The tests vary in length from 30 
to AO minutes. 

The state requires these tests to measure the effectiveness of 
school programs and of pupil achievement throughout the stat^. 
The state will release the I'esults of the testing in November, 




1978. 
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Contact: John A* Dod 

Suuerintendont of Schools 
777-1234 



GRADE 2, 3 PUPILS TO ES TSSTED 
IN UTOPIA SCHOOL DISTRICT 



For laaediate Relaaao 



Grade 2 and 3 pupils in. the Utopia Unified School Uistrict will take 
state-required reading tests during the week of r^7 14, it was announced today# 



The tests arc part of tho statewide California Assessnent Program, which 
Erasures the effectiveness of school programs and pupil achievesiont throughout 
the state. The results will be reported by the state in November. 

Testing of grade 2 and 3 pupils will take about 30 minutes. The tests 
measure such reading skills as word identification, vocabulary, comprehension, 
and study skills. 

The state testing is in addition to regular tests given the school 
district to discover each pupil^s specific study needs. 
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Utopia onificd School District 

300 Main St. 

Utopia, Calif. 

777-123/> 
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.Model 51) 



For more inforaation: 
John A* Doo 

Superintendent of Schools 

777-1234 For laaediate Use 



ffewa Inforniation Memorandum 
on UpcoainR Pupil Testing 



1. The activity ; State testing of pupils in grades 2 and 3 of the Utopia 

Unified School District will take place during the week of 
May 14. Reading tests will be given in each child *s regular 
classroom. They take about 30 minutes to complete. The results 
will be reported in November by the 9tate. 

2. The puTposs : This is part of the California As3essrx5nt Prograa, which is 

sponsored and required by the state. Its purpose is to iQeaaxire 
the effectiveness of school prograas and pupil aehievement 
throughout the state* 

3. Other details ; The reading tests jseastire several ski?ls: word identification, 

vocabulary, comprehension and study skills. 

Theso tests are in addition to regular tests sponsored the 
school district to discover the specific scudy needs of each 
pupil. 



Two Sample News Releases on Test Results from Los Angeles 



First Example from Los Angeles 



Los AngeU^s City Schools 
Public Infonnation Office 
Jerry Custis, acting director 
687-4341 
5«n-73 

Contact: Bill' Bol ton 



LEVELS OF ACHIEVEMENT MAINTAINED FOR SIXTH AMD 12TH 
GRADE STUDENTS IN THE LOS Af^GELES SCHOOL DISTRICT 



Irnmediate Release 



Sixth and 12th grade students in the Los Angeles school district are continuing 
to achieve at about the same level as last year, according tj new districtwide scores,. 
made public last week (May 10). 

A sunuTjory of scores, based on state-mandated tests administered last October, 
reported the results of sixth and T.th graders in language, spelling, arithmetic and 
reading. 

All scores are based on national norms in which the 50th percentile is 
considered a.verage. 

Districtwide median percentile scores for grades six and 12 In the four subject 
creas are as follows: 

Re ading Language Spelling Arithmetic 

Sixth Grade 

rm 33 32 37 30 

1972 33 31 36 30 

12th Grade 

197T~ 45 36 45 42 

1972 44 34 43 41 



(more) 
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Achievcrrent Levels I-t3intained 
2-2-2 



III reading, 125 of the city's ';36 elementary schools and 24 of the 49 regular 
high schools scored at or above the national average.' 

The tests were administered prior to the implementation of the school district's 
preferred reading program and the allocation of additional resources to strengthen read- 
ing instruction. 

As part of the district program, 118 elementary reading positions and 108 
bilingual English-as-a-Second Language teachers v/ere addeo in 1972-73. 

In addition, Superintendent of Schools William J. Johnston has recorrenended an 
expenditure of $10 million in 1973-74 for the district's reading program and an 
additional 108 bilingual ESL elementary teachers, 216 part-time elementary 
instructional aides and 324 part-time secondary instructional aides. 

Superintendent Johnston said he is "optimistic that the decline in 
achieve»n»jnl has been arresied and that the additional eir-phasis placed on reading will 
make it possible for the district to reach its stated goals in the spring of ig74 
v/hen the program will be evaluated." 

The goals call for all schools that scored below the 20th percentile on t.he 
1971 tests to experience a minimum gain of 10 percentile points and those schools 
that scored between the^Oth and 45th percentile a minimum gain of five percentile 
.oints, both by June of 1974. 

Comparison of tests results for the last tv.'O years reveal that the sixth 
graders scored at the same grade level on all four achievement tests in ig72 as they 
did in 1971. 

This is the first comparison in the four-year testing period in v/hich no drop 
in grade level scores occurred, although there was a decline of one percentile ooint 
in the median scores for language and spelling in ig72. This percentile drop is the 
product of matncmatical tables rather than any change in the actual achievement. 
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Superintendent Johnston said the district is administering the same tests to 
the same group of sixth graders this rr.onih to determine the exte.it to which pupils 
nave improved during the school year. Results of the testing program will be 
available by the end of June. 

Participating in the testing program v/ere 46,521 sixth grade pupils, about 96 

r 

per cent, and 34,847 12th graders, approximately 90 per cent. 

In the sixth grade tho top narks ware made in each category by: 

Reading Pacific Palisades, 818 Via de la Paz, Pacific Palisades, 80, anJ 
Dearborn Street, 9240 Wish Ave., Northridge, 79. 

Language Encino, 16941 Addison St., Encino, 73, and Lanai Road, 4241 Lanai Rd., 
Encino,. Pacific Palisades, and Third Street, 201 S. June St., all 70. . 

Spelling Mt. Washington, 3S81 San Rafael Ave., 76, and Oso Avenue, 5724 
Oso Ave., Woodland Kills, and Third Street, both 71. 

Arithmetic Canyon, 421 Entrada Dr., Santa Monica, 96, and Dearborn Street, 85. 

Top 12th grade scores v/ere made by: 

Reading Palisades, 15777 Bov/doin St.,, Pacific Palisades, 66, and Taft» 
5461 Winnetka Ave., Woodland Hills, 63. 

Language Palisades, 63, and El Camino Real, 5440 Valley Circle Blvd., Woodland 
Hills, Taft, and University, 11800 Texas Ave., all three 52. 

Spelling--Pali3aaes, 64, Hollyvwod, 1521 N. Highland Ave., and University, both 

58. 

Arithmetic Palisades, 73, and El Camino ReaK 71. 

# ; { 
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Second Example from Los Angeles 



Los Angeles City Schools 13714 

Public Information Office 

Eva Hain, Director 

687-4341 

11-9-73 

Contact: Bill Bolton 



PRIKARY reading scores in LOS ANGELES 

SCHOOL DISTRICT CONTINUE UPWARD TREND Immediate Release 



Primary reading scores in the Los Angeles school district continue their 
upward trend. 

The 133,781 first,, second and third grade pupils tested in Hay of this year 
showed improvement at all three grade levels. 

"We are pleased that the reading achievement levels continue to rise and we 
are hoping that the new districtwide preferred reading program and the addition of 
reading personnel this school year will produce further improvement," said Superin- 
tendent of Schools William J, Johnston, 

Median percentile scores for the first three grades show the following 

results on a citywide basis: 

1971 1972 1973 

Grade 1 39 44 46 

Grade 2 38 43 44 

Grade 3 — 36 37 

In 1971, third graders were administered the Stanford Reading Test, which has 
since been replaced in t.^ jtate-mandated reading testing program. Thus, the scores 
for that year are not considered coniparable with those obtained from the Cooperative 
Primary Reading Test, now used at all three grade levels. 



(more) 
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Although the school district i>iitiated a $10 million preferred reading 
proigram in September, the current reading scores are the result of tests administered 
last May and would not reflect this increased emphasis on reading. 

The $10 million appropriation provides ^n average increase for reading of 
about $15 for each elementary and secondary pupil in* the district. 

Teachers, advisory council members and school administrators have worked 
together in defining godls and objectives for their schools and then selected the 
reading instructional programs which they felt would meet the requirements of 
individual pupils at their schools. ^ 

Superintandent Johnston said, "In addition to continuing our efforts to 
ir.prove reading achievement for'our pupils* the preferred rsadlng program is 'In 
keeping with the school district's policy of decentralization and the shifting of 
seme of the major decision-making to the local school level." " 

In a further expansion of the reading effort, the school district provided in 
the current school year budget $2.4 million to expand the bil ingual -bicultural and 
» Engl Ish-as-a -Second Language programs. 

The funds support ICS additional ESL elementary teachers, doubling the number 
added in 1972-73* and provide for 216 elementary instructional aides and 324 secon- 
dary instructional aides* all assigned on the basis of need to the 12 administrative 
areas of the school district. 

"These are modest expansions which will strengthen our reading program and 
should lead to improved reading progress," Dr. Johnston said. 

The May tests were administered in 437 elementary schools. Average scores , 
of first, second, and third grade pupils in 125 of those -schools were above the 
50th percentile. * 

In addition, first grade averages at more than 200 schools, second graded 
averages at nearly 200 schools* and third grade averages at more thanJ50 schools 
were above the 50th percentile. 

\ 

(more) 
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The average pupil scores by the 12 administrative 


areas 


are as follows 






AREA ' . ^ s 


GRADE 


1971 


1972 


1973 




^A 


(Saio Pedro, Harbor, Carson, 
Ga^dena areas) 


• 1 
< 2 

' : 3 


39 
• 39 


43 
43 

"38 ^ 


.43 
. 46 
39 . . 




' B 


(Huntington Park, South Gate, Bell 
portions of South Central* Los Angtles) 


1 

2' 

- 3 . 




38 
31 
23 


39 
32 

26 • 




C 


(Portions of South Central 
Los Angeles and Westchester) 


1 

2 
3 


33 
26 

* 


39 
32 
22 


42 • 

33 

23 




D 


(West Los Ar.geles, Venice.^ 
Pacific Palisades) 


1 ' 

2 

3 


^ 51 
51 


52 
51 

' 50 






E 


(Portions of West and Southwest 
Los Angeles, Crenshaw area) 


1 ' 
2 

3. 


34 

35 


40 

• 37 
29 


42 

4C 

. 29 




F 


(Hollywood, downtown Los Angeles, 
portions of South Central Los Angeles) 


1 

2 
3 


35 
30 


41 

35 
29 


40 
35 
29 






(East Los Angeles) 


1 

2 
3 


35 
28 


36 
30 
24 


39 
35 
26 




H 


(Northeast and portions of 
East Los Angeles) 


1 

2' 
3 


38 
36 


39 
43 
30 


40 

38 
'34 




I 


(East San Fernando Valley and 
Sunland-Tujunga) 


1 
2 
3 


42 
50 


47 
50 
48 


51 
51 

46' 




J 


(Central San Fernando Valley) 


1 
2 
3 


56 
54 


60 
59 
54 


67 
58 
56 




K 


(North San Fernando Valley) 


1 
2 
3 


38 
41 


46 
49 
40 


50 
49 
45 




L 


(West San Fernando Valley) 


1 

2 
3 


65 

CO 

58 


70 
61 
58 


73 
62 
60 
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Legal Obligalious on the Release of PiihUo Iiiforniati^in 



When do state test resuUs become pubHc mfor- 
niation? According to (ahfornia law, they are 
public rt5r soon as they are reported to the State 
Board of-liduca'tion in November. 

The law does not, however, invalidate the 
custom of most school districts to wait until later 
to release the results locally and report them 
formally to their boards of education. But the law 
docs require that v.hcn rcqui.>K\l the State 
Department of Lducation. the office of the county 
superintendent of schools, and \ottt own JLstrit!, 
ojfict' must give out district, individual schooK or 
individual ^rade results after the November meet 
ing of the State Board. 

Two parts of state law apply here. The first, the 
California Records Act (sections 0250 to ()2()1 of. 
the Government Code) requires that all material 
defined by law as public records be open to 
inspection at all times. Section 0250 states that 

. . access to information concerning the conduct 
of 'the people's business is a fundamental and 
necessary right of every person in the state/' And 
Section 6253 states» in part: ^ ^ 



Public records arc open lo inspection at all times 
during the office hours of the state or local agency, and 
every citizen has a right to 'inspect any public record^ 
except as hereafter provided, livery agency may adopt 
regulations stating the procedures to be followed when 
making' its records availajble in accordance with this 
section. 



Thomas M. Griffin, Cjhief Counsel of the Depart- 
ment of Education, c^oncludes that state testing 
results arc considered i^ublic records and that school 
boards and the Department of education arc classi- 
lied as state or local' agencies. ''Citizens have th^ 
right to get copies of/in formation unless the statute 
defines it as confide^ntial," he said. 

The second part^ of state law is Chapter 9 of the 
same Government^ Code, also known as the Ralph 
M. Brown Act. ;it requires public commissions, 
boards, and councils to conduct "the people's 
business" openly and with full public knowledge 
and consent. Section 54950 states. 

riie people in delegating authority do not give their public 
servants the right tu decide what is good for the people 
to know and what is not good for them to know. . . , 
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Reporting to Staff and Community 



. . . [You] should not think of communicating educational assessment information to the "public** 
but to several publics. , . . Different audiences have different informational needs. These audiences 
arid needs-must be identified and accommodated. 

Releasing Test Scores 



The news media—important as they are-may 
not be, your prime means of communicating test 
results. For one thing, not everybody pays heed to 
the news. And for another, all news media selec- 
tively filter the information they report to their 
listeners or readers. 

Listen for a moment to the findings of Ned S. 
Hubbell, a pioneer pblltaker and public relations 
consultaht-for school districts. Hissurveys^ Hubbell 
says, point out that different types of people pay 
attention to different sources for their information 
about the schools. Parents, for instance, get their 
school news from these sources (listed^n order of 
influence): 

/ L Their children 

2. Other people (neighbors, peers, school 
employees) 

3. The news media 

4. School publications, newsletters, and so on 

Non parents, however, find out abo^ the schools 
from: 

I iC news media 

2. Other people (neighbors, parents, peers, 
school employees)' 

3. Children of other families 

4. Organizations 

Thus, as many have always suspected, ^the back 
fence sometimes is as powerful as the front page in 
communicating information. 
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Our Main Audience 

Hubbelfs explanation covers how we might 
communicate test results (using what middlemen 
or what media). The next question is to whom we 
should be doing our communicating for the 
strongest results. Nojpparents (call them taxpayers) 
and parents are two of the four main target groups: 

The pupils (their scores) 

The parents (their kids) 

The taxpayers (their money) 

Tlie staff (their jobs)' 

Now applying Hubbell's explanation to the four 
main target groups, we can try to list all the 
different ways in which people find out about 
what's happening 4n the schools. This might be the 
listing for a typical district but might differ 
somewhat in your own district: 

• Parents get their information by: 

Talking to their children 

Talking with friends and neighbors 

Talking with teachers and other school 

employees 
Telephoning their local school 
Attending PTA meetings 
Reading the -newspaper; listening to radio 

and television news 
Reading school-produced publications 
. --^r^ 

^Thcrc might even be others of primary importance in your 
district, such as legislators, education. associations and unions, local 
mumcipal- and** CIVIC officials, citizen groups, Pl'As, and advisory 
councils* 
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Taxpayers (those not having children in the 
schools) get their information by: 

Reading the newspaper and listening to 
radio and television news 

Talking with neighbors, friends, and chil- 
dren they know 

Talking with school employees 

Listening to what's said by organizations 
they belo^ig to or to which they pay 
attention 

Pupils got their information by: 

Listening to their teachers and principal 
Talking with other school employees. 

aides, secretaries, custodians 
Talking with other pupils ^ , 
Reading school newspapers and other 

school publications and notices 
Attending school assemblies and programs 
Reading the newspaper and listening to 

radio and television news 



• Staff members get their information by: 

Reading notices, reports, and bulletins at 
work 

Attending schoolwide and department staff 

meetings and briefings 
Talking with other staff members 
Reading school and school district publica- 
tions 

Reading the newspaper and listening to 
radio and television news 

Three things become apparent here. One is that 
for many of the target individuals, the news media 
play a sort of background tole, one of reinforcing 
or contradicting their primary sources of informa- 
tion. A second is that much of this highly 
important communication takes place at the local 
school or under its auspices. And third, some 
persons who have been little noticed are probably 
very, influjcntial cc.imunicators' secretaries, aides, 
and custodians, to name only three. 



Effective Communication: Take Care of the Honie Front First 

Twenty years of work in school public relations have led Midiigan's Ned S. 
Hubbell to a fundamental conclusion: "Effective communications beghi, center, and 
are reinforced withir ,the organization. If you haven't made sure your employees. are 
, welj/tn formed. Group A will be saying one thing to the outside world, and Group B 
wfU'b^ saying another.'' 

Hubbell thinks school employees should be considered a major informational arm 
of the school system, A conductor of public school polls, Hubbell found that the 
views of most school employees -whether teachers gr not are seriously regarded by 
the community on what takes place at their school. 

"Other people do asL them about such things as test results," he said, "and woe 
to the school district where all an employee knows is what he's reading in the 
newspaper." Hubbell noted a certain pride by employees about their schools and 
' frustration in some who do not feel well enougli informed. 

Naturally enough, he sees the principal as the key communicator at the building 
level. Step 1 in Hubbell's plan calls for the superintendent to convene work sessions 
to help each principal interpret his or her own school's scores. Thus armed, 
principals move on to step 2, conducting family meetings at their own schools. 

Everyone should be asked to the meeting; vice-jirincipal, counselor, teacher, aide, 
secretary, custodian, and part-timers' too. Test results are explained and analyzed, 
future steps are discussed, and questions are answered. Other, more specialized, 
meetmgs can be held later, but the family meeting helps all concerned learn enougli 
to talk intelligently to nonschool people. 

Hubbell takes pains to argue that everyone on the staff must be involved. "The 
secretary is the first one to whom parents speak when they call a school to find out 
about those reading scores that appeared in the morning newspaper," he notes. And 
others on the staff, whether full-time or part-time, are believed by the public to have 
insidc-knowledge-of-the school. 



From Information to Action 

Now we can put together our information about 
how to {techniques and middlemen) and who to 
(target individuals) and list all the different means 
of communication that should be considered 
except for the news media, discussed in Chapter 
VII. For all of our target audiences, a common 
thread of information about test results exists that 
needs to be communicated. The need is genuine 
even though persons in different roles want differ- 
ent kinds of information. The emphasis and degree 
of detail may vary, but the basic information to all 
should include the following points: 

• What were the results? Some. persons may just 
^jL want to know whetjicr the scores are high, 

\ medium, or low and whether the scores are 
\ improving. Others are interested in specific 
> numbers, exact comparisons, or particular 
schools or levels. 

• How do you feel about them? Is the district 
satisfied?* Is the district concehied? Do you 
see the results as the outcome of considerable, 
well-spent effort? Or are the results a signal to 
get such effort started now? 

• What are the reasons for the results? How do 
you account for the level of results achieved? 
Do you have any other figures or results that 
confirm the test results or point out different 
trends? 

• What will he done about the results (or with 
them)? A study of newly found weaknesses? 
New programs, new emphases? Further analy- 

. ^ sis ofthe detailed figures? 

• llow do the results affect you? Different 
persons have different concerns: parents-a 
good education for their children, taxpayers- 
value and efficiency for their tax dollars; 
pupils a sense of achievement or failure or 
potential changes in their courses of study; 
staff members-job security, reputation, 
potential change in their methods. 

These five basic information points may look 
familiar. You may recall them because in a slightly 
different format, they provide the basis for your 
report to your board of education and for your 
information to the media that were discussed in 
chapters VI and VII. 

Communications Teclini(jnes: A Checklist 

Here, then, is a listing of ways to reach the four 
. target audiencds with your information. Please 



note that as the audience becomes more removed 
from the school itself, it relies more heaviiy on 
informal means of obtaining information (and less 
on receiving direct messages from you). By the 
time we reach the nonparent taxpayer, wc find 
that virtually all of their information comes from 
secondary sources such as reading the newspaper 
or talking to parents. The lesson to be learned here 
is simply that good primary communication (to the 
media, staff, and students) pays dividends both now 
and later. 

• Communicating with staff 

1. Principals' briefings. Conduct 

detailed district-level briefings for 
principals, handing out all relevant 
written material, charts, figures, and 
tables that they will need. Be sure 
that they know the district's .posi- 
tion and any steps in the offing. 

2. School-level **family meeting." The 

principal calls together all staff 
members (everyone!) to review the 
results-perhaps for more than one 
session so that everyone is included. 
Since teachers will meet later for 
detailed analysis, the principal may 
not need to proceed further than a 
thorough summary for the full staff. 
Family meetings should, of course, 
be conducted on school time. 

3. Schoolwide bulletin. An informa- 
tion bulletin for posting and use 
throughout the school will serve as a 
handy reference for both staff and 
students. It also will serve to refresh 
memories of the information covered 
at the family meeting. 

4. Distrietwide bulletin. A districtwide 

.bulletin can be produced through 
the use of either (a) the regular 
district staff newsletter; or (b) a 
special .testing information bulletin 
for use around the district. Perhaps 
material prepared for the media will 
be serviceable for this purpose. Both 
thp results and necessary corrective 
action can vary considerably be- 
tween the district level and school 
level. 

5. Telephone readiness. Plan ahead for 

telephone inquiries. At each school 
and at the district office, someone 
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should be designated to handle all 
telephone inquiries on test scores. 
The telephone operator needs to 
know who that person is. 

• Communicating with pupils: 

6. Review by teacher^^ The teacher, of 

course, is the pupil's primary source 
of official inforniation about the 
school. Teachers should conduct 
reviews^\of test results and their 
^ nieaning during class time. Since 

' each pupil then becomes a second- 
ary communicator, teachers should 
be sure that pupils have the impor- 
tant facts in mind, whether or not 
they remember exact numerical 
results. What they tell their parents 
will likely have more influence than 
what you write jn your parent news- 
letter. 



7. Article in student newspaper. An 
article can be useful at the interme- 
diate and high school level. One 
should remember, though, that tech- 
nical circumstances \often impose a 
one- to two-week o^elay in getting 
information into a student news- 
paper. 

8. Briefing for student leaders. On 
many campuses the views of student 
opinjpji leaders carry as much 

. weigliL as Jhose_of the faculty. Stu- 
dent leaders should be told the full 
storV. 

9. Assemblies and pupil meetings. 
Time can be set aside at regular 
pupil assemblies for an overall 
review of results. This practice prob- 
ably works better as reinforcement 
of teachers' reviews than as a source 
of original information. 



o Communicating with parents: 

IOl a send-home note. In the eariy 

\^ grades the teacher or principal can 
^prepare short announcements for 
Oie day results are released, briefly 
summarizing the results and telling 
parents how they can get more 
information. Distributed in the 
afternoon to pupils, the announce- 



ments will reach the home on the 
same day. Columbus, Ohio, schools 
insert in report cards an information 
sheet about testing, accompanied by 
an invitation to call the principal for 
more information. 

11. School newsletter. A complete 
review of results in newsletter or 
bulletin form should be planned to 
reach the home at neariy the same*?' 
time as the release of results to the 
public. Use can be made of the 
newsletter published by the school 
or the district office. Samples of 
newsletters can be found in this 
chapter's resource material. 

12. Parent-teacher conferences. Teachers 
should be prepared either to respond 
well to questions about test scores 
or, if desired, to bring up the subject 
themselves. 

13. PTA briefing. Officers of local PTA 
councils and school advisory coun- 
cils are consulted by many in the 
community for authoritative views 
on school matters. They need to be 
briefed-both at the district and 
school Jevels-before general public 
release of scores. After the release it 
may be useful to call special meet- 
ings of these parent groups to exam- 
ine the results. 

14; -General parent meeting. Some 
schools hold monthly evening meet- 
ings for all parents. Whether such 
meetings are held in your district or 
not, it may be appropriate to call 
such a meeting to review test results. 



• Communicating with taxpayers: 

15. Newsletter. Most communication 

with nonparent taxpayers wiii be 
thrdugh indirect means. Some dis- 
tricts, however, mail a newsletter to 
all Households in the community 
whether or not they have,5chool-age 
children. Included is an explanation 
that all local residents have a finan- 
cial and social stake in the schools. 
Such a newsletter, of course, should 
contain up-to-date information on 
test results. 
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Other Good Ideas 

Many good ideas for specialized communication 
are in use throughout the state. They include: 

• Centinela Valley Union High School District: 
Superintendent Thomas D. Barkelew held 
work sessions for mathematics department 

.^chairpersons in the district's high schools. The 

chairpersons carefully analyzed mathematics 
test results, compared subskill scores with the 
schools' mathematics curriculum, adding and 
deleting subject material as appropriate. Now 
district tests are '^eing developed to improve 
computational skills. 

• San Marino Unified School District Pupil 
Personnel Services Director Kenneth W. 
Ogden believes that districts must explain 
testing and its implications for pupils. "We are 
doing everything we can to encourage stu- 
dents to take testing seriously. A strong 
emphasis is placed on performance. We 
explain matrix sampling and point out that 
each test score is part of a composite score^ 
and each is a reflection of the programs 
offered at their school.'' 

• San Ramon Valley Unified School District, 
Curriculum Program Coordinator Martin 



Tucker holds workshops on testing for PTA 
groups in his district. He takes care to explain 
the meaning of professional testing jargon and 
lets PTA members take a sample lest. 

o Claremont Unified School District: Research 
and Information Officer Jean Hazelton uses a 
question-and-answer format in the district's 
newsletter for parents. Family Gram, to help 
parents thoroughly understand test results 
and their meaning. 

• San Juan Unified School District: Phillip 
Oakes, Director of Research and Evaluation, 
builds his district testing program around the 
California Assessment Program. In this way he 
avoids duplication of testing at a particular 
grade level, saving both money and teaching 
time. When the results arrive, he meets with 
the cadre of reading consultants as well as 
with the principals (divided into four smaller 
groups - to enhance communication) and 
department chairpersons of the high schools. 
Oakes feels it is important to emphasize to 
these groups that the results are theirs, not 
his, and that he is there to communicate the 
results and to be of service to them in helping 
them to understand the results. 
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Resource Material lor Chapter VIIl 

Sample School District Newsletters 



Samples of the ways in which some school districts report student test scores in 
their newsletters to staff and parents are presented here and on the following pages. 



The Ocean View Elementary School District (in Huntington Beach) uses artwork 
excellently in its "report card'' lo explain to parents how pupils did in each area of 
instruction. The publication also reports comparisons in the district's financial Ipvel 
and community attitudes towards the schools. The complete publication is not 
shown here. 
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This comnuinity newsletter, published by the Placcntia Unified School District, 
describes what the different schools are doing to improve reading and reports the 
district's overall test scores. 



First 'R' Stressed in schools 



Bjrhara Peterson, j^^istjnt ^upcrinicndcnl 
of in^ruclionjl ^crM^cf 

At Van Burcn Flcjncnjjr) S<h<>ol. thifd 
through ^i^th graders ^pcnd a hjif hour a 
d3) MorVing in ihcir nc^ reading skilU 
\tntcr uith maicriaK «Ie^ied for each in. 
diMduJl'^ needs 

••l\cr\ \hi!d m the third throtgh ^uth 
grades hj\ tjVen adl^antjge ofthe program, 
and the progress of the student) has Tar c\- 
our expectations." according to Priin> 
opal Stan Graham 

"•l"^e^ with all the enipha<j\ plactd in Ihe 
TttMer grade^. ^e VnoM all children are noi 
expert le.^der^ and special program\ in the 
)unior and ^enlor high jte designed to help 
them. * PeterMJn \aid 

A( Kraemer Junior High Mudentt from 
throughout the diMrict ^ho are not reading 
ai their fvuential lc^eIs ma\ N»orV with a 
reading \p<Mali^l in the iih for an hour after 
NChool lvm.e a i*eeV 

"Thi^ hour m the lab is a treat for 
^tudenl^. noted Dehbie Mercter. the 
teacher "At thr\ age, motivation is one of 
(he ^hieffactcr^ in getting ^oung people to 
read, and the interesting materuf^ and 
machine* maVe learning fun ^' 

A nei* reacting program at Dernardi^ Yor- 
ha Junior High ainu at motivating "already 
gotKi * rejderv "to m^till an appreciation of 
reading av a pleavant experience ' 

Appro rm.iteU ti*o third* of the studentc 
ma\ choose *'elettives" for nmc-^ceV 
peritnls in uhr^h the* vorcenuale (heir 
reading effort^ in such areas jc science Tic 
tion, dr^u^a p(Ktr* ttr short stones 

NeM at M (amino Real High School ic 
the learning MX) reading program uhich 
j\u> u^ec audio jnd cisual media to help 
ctudent^ huild ^^Hrabulat* and comprehen< 
sion and perceptual sVilU at their o^n pace 
Because it is designed for adult*, the 
materi.il ca*il> fitc into the cchtHtl's program 
for .cK'ational education 

At \.ilencij High School *tudentc ma\ 
*ign up for cecsions in thcreading bb ^hcre 
thev uorV indi^rdualN and in ^inallgroups 
Ihic nuti.th Ihe entire \alencia ciudent 
Kvdv I* participjting in a -0 da* phonicc 
recicM rn which e*erv teacher cpends jbout 
Jf»vc,mwmc> 10 each Jiss uoilmg with 

Mords jnd counds 

'I vcrc c<.hool in the dictrut hjc reading 
jc itc number i>ne prioritc |>r IVter^on 
^aid "Our g»»ahc to procjJe e*crc v^okl with 
necCc*arc reading cVills uht^h h^- c in uce 
throughout life 

Ar7ER>H0URS LEARNING • Ron Hall.aavatith gradar at Yorba Junior Hlgh« 
and Doug Stinaon. Kratmar a«venth grader, take advantage of apeclal 
aqulpmant In reading lab open after acticol at Kraemer. 



AmcfKan vhildfen do read and the 
vkholc lhc> read rather Mell, obNcr*ec a 
*oild renouped rejding espcri And judging 
froiT) Ihe latect test vc^ore^ children m 
PlaLentia read better than most other 
AmerK'an children 

I ast >ear Ptacentia second graders cvored 
higher than 78*^ of their peers throughout 
the state, uhile third gr.ider* ranVed in the 
71rd percentile and Msth graderc m the ^Hih 
percentile High vcho<»lceniorMnthedi%trKl 
far esceeded the ;spcvted sv««re 10 rank in 
the *Mrd percentile 

|*en uith the relatheK high wores in 
readings the dicUict i* continuing to strecc 
reading sKillc and Ihe h«>ard of education 
has placed reading ^ i the ti>p c»f the IM of in- 
siruvttonal rrioritie^ in budget and program 
c»>ncKleraiionc 

This, philosophc IS rellected m the addi 
lion this cear of t^*o elementarc reading 
specia'ictc. "eggv Hammer and (^eraldine 
fhornion. and inMhe metJia center* vkhivh 
\»iH be operating at jII 14 elenieniar* 
schools hv lest September 

•The tabs pro*ide a *ariet* s>f maleriat* 
10 help c^iWren learn to read, both b* uork. 
ing al<>ne and wnh teacSers explained Or 

^ Bus box bulges 
? with lost booty 

:*! I tffuiuff tfouot.'tiit ti^futrft ,^ 
{ liHiit and iunch hna Au> hftn 
'\ itniai^cJ in thf Jotna hut Ki'tt i' 
> J'4/tftf thi 11,1/ tltii utptr\tu>r » t 

tnintp.>rtatt*ot I J \{tff Hi' ^ 
- <<' jff' nj .»/ *t \^ 
A the JiUfut huin trrnt (<* hr a \ 
\> t<it"ftlf pftiif tor (hitjren to hw 
thimi lihfn thf hmei return r^ 
thf hjrn Jriirrf t/fltnt thr (iHuh 
and add them to tSr toit'und' 

tvurtd bo\ ^' 

^* Par fin ^A<» t]nd ttfm< ntnunf^ \\ 
'i\ trtim ih(tr^ ihifdrrn < ht/ft^tn^i 
,j urr ur^fj ttt nomt r<» iht dtitrtit 

hrodijuartfrt Jt t *I>1 I ; 
Oranzeihorpf lw ieunh ihf^ 
hnt and-l'iund hill .\ 
l\ ilt^trii anj othfr uiohh itfnn ^ 
'/ y,h*(k jrf r\t*t rt\lo>'*ud h\ tkt %nii '.. 
^ tpt ific irhi*'tf >AJ' v»»// hr *fnt r»» 

TffUtina \ffi tt>r dutrthulton to 

the nffd\ \ \ 





rAN BUREN LAB - Teacher elde 
'onl Llebherr heipe fourth greder 
/Ivlana CornelUon find approprlete 
materlala to develop reediog ekilla. 

May 27 election set 
for building bonds 

\ bond election hac beencalted Ma* i"* in 
a \evond effort to pro*ide the needed 
r>nl!i<>n tn^nd authoti/aiion to Veep th? dl^^ 
tricj in the Stale School Huilding Program 
for the nest fi*e *car* 

A Mioitar nieacure wjs narroul* defeatesl 
Marvh »l \*hc*n the *ote fell I 4 per cent short 
«»l rejc hing the 66 7 per c^ent needed to pjcs 

"Nothini; hac changed since the das 
beli>re the election," noted tructee John 
iljlducci "We need the bonds as hadic n4»w 
ic Me sJui then 

f)i*lrict oflKiaN ^oncerv iiicel* eMimaie 
in m^rrace of ciudents ocer the nest 

flee *earv P,4ct-rigure^ sbitu gr(»utha*erag' 
ing 1 (»66 ciudent* a *ear cinte l*'6< 

*"\\crc* beginruDic \i> see de*cK«pmc'«« 
opening up uiih Ihe louenng td intercct 
rjies, ' c.iid Supi John 1*nek p^tiniing 4tul 
IhAl irict maps jlreids hj*e be;n TileO 
Mhuh would add aboui 4.<XKl ctudeoic to |he 
■"^hiH^I *sclem 

'*^^ e owe It to our taspj*er\ to let theni 
Vnou thu lases will hi raided if wehase to 
build *th\»oU ouldde the state projirjm he 
added 

I iidef ifte ctjte progtani ine it^ai 
buitding las rjle is held lit in acerage ol 
*<fk SUXt ac*cs*ed salualron. the rate local 
pjifon* ha^e been pa*ing since I'Mi The 
dicirivi I* ohiigjicil to pas the KO lent rjie 
ihro.jgh HHH The additional S:<« nujlion 
auth4>rf/ation wiiuld c«»niinue it ihiou^h 

S\t\K e the i.ici bond lothon/aiion m VH^, 
the cs hiU't dietrnct hjc resei*ed almost S6 X 
niilhon m 'interest lojn* from the date 
ilnjoct J thud ol the %t>nstrui,tion vOst\ lor 
fo'jf clemcntars s<.h4n>lc, V«»rh i Junu'i 
Hi)2b I I ( ammo ,»nd I cperan/a high 
^chootc .ind *e^era' cchool idditionc 



A question-and-answor format helps the Tustin Unified School District report test 
results in its newsletter. The front page is shown below, and the reverse side is shown^ 
on the next page. 



A SPECIAL REPORT ON 
STATE TESTS 

DECEMBER 3. 1974 

Tustin like other school districts across California, recently received the results of the 1973-74 
Ita rie iVproSran F^^ this spe'iai report, we asked Tustin Unified School District Director 
of Educational Services Marjorie V^c.. to explain the scores. We asked the questions, and Mrs. Veeh 
answered. 




A. H0^^f did TtiiU^i iCurfcuti do <i\ thz XCiti? 

A. Quite well! When compared to all other 
districts in the state, Justin's second graders' 
trcdian score was at the 88th state percentile 
rank. The third grade s^ore was at the 87th' 
state percentile rank. In other words, 
88 percent of the districts in California had a 
second grade median score lower than Tustin's. 
In both grades state ranks were higher than 
those of 72-73. 

In grade six, Tustin maintained its 72-73 
ranking in the top ten percent of California 
districts. Our s ate percentile ranks'were; 
reading"93rd in 72-73, 92nd in 73-74; 
language--92nd in 72-73, 93rd in 73-74; 
spelling--92nd both years, arithmetic--91st 
in 72-73, 94th in 73-74. 

In 1972-73, grade twelve district scores were 
d composite of those attained in the four 
high schools of the Tustin Union High School 
District. Comparisons are, therefore, incon- 
clusive since It is not possible to isolate the 
scores of the high schools included in the 
Unified Ois*-ict. However, for lack of better 
data, both. -years A resul ts^are reported. State 
percentile ranks were; reading- -80th in 
72-73, 95th in 73-74, 1 anguage--95th in 72-73, 
96th in 73-74; spel 1 ing--96th both years; 
arithmetic--9^nd in 72-73. 97th in 73-74. 

n. Ho<c rfc CaU^oxnta Acotei comfxiae uitth the 

A. State^'i^Je, pupil > m grocJes twO and three 
scored as well in reading in 1973-74 as in 
1972-73. In both years the California medians 
were si ightly above national norms. In grade 
SIX reading, language, and spelling scores 
declined slightly while pathematic scores 
remained about the same. In all four areas, 
state medians were Delow national norms. Grade 
twelve scores showed the sane pattern as sixth 
grade scores with the largest decrease in 
language; in this grade also medians were below 
national norms. 



Q. Ufec ^taXz 4CC1W, aic Tu6t<.n icotcs aCw 
bcicM national tiovni? 

A. No. Tustin's scores are above national norms 
in all areas except twelfth grade language where* 
our median score is at the 47th percentile} three 
percentiles below the norm. Twelfth grade 
reading is at the S8th percentile, spelling is' 
at the 55th, and mathematics is at the 68th. 
Equivalent ranks in grade six are: readinq, 
66th; language, 57th; spelling, 56th; 
and arithmetic , 63rd. 

0. (aiiaX do -die -!>lcuCc t<ut& mzauixc? 

A. The tests used measure only reading, 
-mathematics, and language-'the 3 R's-- 
andihen only a sampling of these skills 
are^^tested. For example, the grade six 
language test includes only 25 items to 
punctuate or capi tal i ze correctly, 30 items 
in which students must choose the best word 
or phrase to complete a sentence, and 30 items 
for spel 1 ing--each a list of 4 words from 
which students choose which is misspelled. 

Major subject areas such as 'foreign languages, 
geography, history, and science are not 
measured; Neither are .such areas as art, 
music, citizenship, or technical education 

All the tests do is provide objective 
information from an impartial source regarding 
levels of student Derfonnance-- in the skills 
tested. 

Q. VczJ>n*t the dufuct a4C oChcA CCAti^ 

A. The State Assessment Program measures group 
achievement. To supplement it and to provide 
information about individual pupils, district 
selected tests are also given. 

One way to estimate a pupil's anticipated 
achievement is to measure his academic aptitude-- 
what is commonly reported as IQ. Research has 
proven that an individual's score on a single 
standardized group test should be interpreted 
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with caution, on another day or in another 
situation It might have been ten points higher 
o»' lower. Therefore, Tustin administered 
the California Test of Mental Maturity at grades 
one, three, six, and eight in 73-74 and again 
this year. With several scores available on 
an individual, a range of aptitude can be more 
accurately determined. 

Individual pupil achievement in the same 
, subject areas tested by the state is also 
measured. The Comprehensive Test of Basic 
Skills, given at grades three, six, and eight, 
treasures agai>ist national norms a pupil's 
performance in reading,' language, and arithmetic. 
In grade nine, the Sequential Test of Educational 
Progress assesses the same areas. Other tests, 
both standardizeo and teacher-prepared, are 
used as indicated to measure pupil progress 
in all areas of curriculum. 



A, The Cal^ifornia statewide testing program for 
public schools has undergone major changes since 
I 1961 when intelligence and achievement testing 

of all students was first required, legislation 
in 1972 deleted the requirement for intelligence 
testing and shifted the focus from individual 
to group assessment. It also provided for the 
development of tests specifically designed for* 
schools in California while retaining the 
requirement that results could be compared with 
national norms. No change was made in grade 
levels or subject areas to be tested, i.e., 
reading in the primary grades and reading, 
language, spelling, and mathematics in grades 
six and twelve. 

The new testing program was implemented in the 
primary grades in 1973-7<J. In grade' one, 
entry level skills which are good indicators 

— of-^chooJ~r^adiness-^nd_tbfcJC£foce_,gqod__ 

predictors of reading achievement were 
measured. The skills measured were those 
related to learning and memory, attention, 
visual perception, and auditory comprehens'ion. 
Each child tvok the same test of 35 items. 

In grades two and three achievement levels 
in word identification skills, vocabulary, 
comprehension, and alphabetizing were 
measured. Both grades took the same test 
so that growth could be more easily observed. 
For the first time in the state testing 
program, the multiple matrix sampling method 
was used. Ideally, a test for statewide 
assessment Should contain many more items 
than on^ intended for individual pupil 
assessment. The California reading test 



developed for grades two and three contained 
212 items, more than four times as many as 
t'le commercial test used in prior years. To 
require each child to take the entire test 
yould bP unrealistic. Accurate group 
assessreU, .however, can be made with only 
a lulle information from each pupil. 
Consequently, the 212 i'*ns were divided 
into 10 tests of 32 items each. Each test 
has an equal number of "hard" and •'easy" 
items and covers the major reading 
objectives. Thus much more information 
can be derived at ji'cat savings in cost 
.and testing time. Beginning this, school 
year matrix sampling will be used in testing 
grades six and twelve, as well as grades two 
and three. 

<l. do wt 4^ aboiU tht ^iMitU? 

A. Pleased, but not complacenti It is 
gratifying, it is true, to read in the 
local newspapers that' Tustin's twelfth 
graders ranked hinhest in the county. 
However, the highest point is usually 
the most precarious of perches; it is 
far easier to go down than to go higher. 
And a very small difference in median 
raw score can result in a large difference 
in state percentile rank, for example, 
consider twelfth grade readers: Tustin's 
median raw score of 24.3 placed us at 
the 95th state percentile rank; just 
two points fewbr would have placed us 
at the 83rd percentile. 

Of much more importance than "ranks** or 
"scores" are the implications for program 
improvement indicated ^v the results. 
At this time, we have questions but few 
answers. .An obvious question is: why 
are langu'age scores relatively lower 
than those for other areas tested? In- 
depth-stud ies-to-Mnd-the.^nswer AC" 
already underway at two of our secondary 
schools. At every school principals 
and staff are analyzing the test »-esults 
for possible restructuring of educational 
programs and practices. We are glad our 
students scored well, but perhaps we 
can do better. Anyway, we will try. 
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